Max level shown:
12026-03-03T18:56:58.926ZDEBGtest_metrics (init_with_steps): Running step start_crdb
22026-03-03T18:56:58.926ZDEBGtest_metrics: Starting CRDB
32026-03-03T18:56:58.926ZINFOtest_metrics: cockroach temporary directory: /var/tmp/omicron_tmp/.tmpmml53i
42026-03-03T18:56:58.926ZINFOtest_metrics: cockroach: copying from seed tarball (/var/tmp/omicron_tmp/crdb-base-build/01a593466edfe10be8065d09575d9108ee70f096422ef511649ff51492c1a319.tar) to storage directory (/var/tmp/omicron_tmp/.tmpmml53i/data)
52026-03-03T18:56:58.938ZINFOtest_metrics: cockroach command line: cockroach start-single-node --insecure --http-addr=:0 --store=path=/var/tmp/omicron_tmp/.tmpmml53i/data,ballast-size=0 --listen-addr [::1]:0 --listening-url-file /var/tmp/omicron_tmp/.tmpmml53i/listen-url --max-sql-memory 256MiB
62026-03-03T18:56:58.938ZINFOtest_metrics: cockroach environment: BUILDOMAT_JOB_ID=01KJTF30Q8FNYCP33P0AJV342W BUILDOMAT_TASK_ID=4 CARGO=/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/bin/cargo CARGO_HOME=/home/build/.cargo CARGO_INCREMENTAL=0 CARGO_MANIFEST_DIR=/work/oxidecomputer/omicron/nexus CARGO_PKG_AUTHORS= CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_LICENSE=MPL-2.0 CARGO_PKG_LICENSE_FILE= CARGO_PKG_NAME=omicron-nexus CARGO_PKG_REPOSITORY= CARGO_PKG_RUST_VERSION= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= CARGO_TERM_COLOR=always CI=true CRDB_SEED_TAR=/var/tmp/omicron_tmp/crdb-base-build/01a593466edfe10be8065d09575d9108ee70f096422ef511649ff51492c1a319.tar GITHUB_BRANCH=ea-ztnrpmzzkqvp GITHUB_REF=refs/heads/ea-ztnrpmzzkqvp GITHUB_REPOSITORY=oxidecomputer/omicron GITHUB_SHA=c07c7685c434eb5b35e41fa764918d3deb749829 GOTRACEBACK=crash HOME=/home/build LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 LD_LIBRARY_PATH=/work/oxidecomputer/omicron/target/debug/build/aws-lc-sys-f7ed203bc494f61c/out:/work/oxidecomputer/omicron/target/debug/build/blake3-f343411090537ee9/out:/work/oxidecomputer/omicron/target/debug/build/bzip2-sys-84e3a942d0ba32cb/out/lib:/work/oxidecomputer/omicron/target/debug/build/libgit2-sys-22a9fe5c9961762c/out/build:/work/oxidecomputer/omicron/target/debug/build/libz-sys-a45bcc1bdf81d4f5/out/lib:/work/oxidecomputer/omicron/target/debug/build/psm-7171f0fac820b0ee/out:/work/oxidecomputer/omicron/target/debug/build/ring-970c0722df753325/out:/work/oxidecomputer/omicron/target/debug/build/tofino-97249330d8dd6530/out:/work/oxidecomputer/omicron/target/debug/build/zstd-sys-4ce5ac15611f058d/out:/work/oxidecomputer/omicron/target/debug/deps:/work/oxidecomputer/omicron/target/debug:/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib:/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/lib LOGNAME=build NEXTEST=1 NEXTEST_ATTEMPT=1 NEXTEST_ATTEMPT_ID=6d9196a9-0f66-4d15-9474-d9848c8f7422:omicron-nexus::test_all$integration_tests::metrics::test_metrics NEXTEST_BINARY_ID=omicron-nexus::test_all NEXTEST_BIN_EXE_nexus=/work/oxidecomputer/omicron/target/debug/nexus NEXTEST_BIN_EXE_schema-updater=/work/oxidecomputer/omicron/target/debug/schema-updater NEXTEST_BIN_EXE_schema_updater=/work/oxidecomputer/omicron/target/debug/schema-updater NEXTEST_EXECUTION_MODE=process-per-test NEXTEST_LD_LIBRARY_PATH=/work/oxidecomputer/omicron/target/debug/build/aws-lc-sys-f7ed203bc494f61c/out:/work/oxidecomputer/omicron/target/debug/build/blake3-f343411090537ee9/out:/work/oxidecomputer/omicron/target/debug/build/bzip2-sys-84e3a942d0ba32cb/out/lib:/work/oxidecomputer/omicron/target/debug/build/libgit2-sys-22a9fe5c9961762c/out/build:/work/oxidecomputer/omicron/target/debug/build/libz-sys-a45bcc1bdf81d4f5/out/lib:/work/oxidecomputer/omicron/target/debug/build/psm-7171f0fac820b0ee/out:/work/oxidecomputer/omicron/target/debug/build/ring-970c0722df753325/out:/work/oxidecomputer/omicron/target/debug/build/tofino-97249330d8dd6530/out:/work/oxidecomputer/omicron/target/debug/build/zstd-sys-4ce5ac15611f058d/out:/work/oxidecomputer/omicron/target/debug/deps:/work/oxidecomputer/omicron/target/debug:/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib:/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/lib NEXTEST_PROFILE=ci NEXTEST_RUN_ID=6d9196a9-0f66-4d15-9474-d9848c8f7422 NEXTEST_RUN_MODE=test NEXTEST_STATE_DIR=/tmp/nextest-state.Q0LfUm NEXTEST_STRESS_CURRENT=none NEXTEST_STRESS_TOTAL=none NEXTEST_TEST_GLOBAL_SLOT=5 NEXTEST_TEST_GROUP=@global NEXTEST_TEST_GROUP_SLOT=none NEXTEST_TEST_NAME=integration_tests::metrics::test_metrics NEXTEST_TEST_PHASE=run NEXTEST_TOTAL_ATTEMPTS=1 OUT_DIR=/work/oxidecomputer/omicron/target/debug/build/omicron-nexus-459a70e126ba99a1/out PATH=/work/oxidecomputer/omicron/out/mgd/root/opt/oxide/mgd/bin:/work/oxidecomputer/omicron/out/dendrite-stub/bin:/work/oxidecomputer/omicron/out/clickhouse:/work/oxidecomputer/omicron/out/cockroachdb/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin PWD=/work/oxidecomputer/omicron RUSTC_BOOTSTRAP=1 RUSTDOCFLAGS=--document-private-items -D warnings RUSTFLAGS=--cfg tokio_unstable -D warnings RUSTUP_HOME=/home/build/.rustup RUSTUP_TOOLCHAIN=1.91.1-x86_64-unknown-linux-gnu RUST_BACKTRACE=1 RUST_RECURSION_COUNT=1 SHLVL=1 SSL_CERT_DIR=/usr/lib/ssl/certs SSL_CERT_FILE=/usr/lib/ssl/certs/ca-certificates.crt TMPDIR=/var/tmp/omicron_tmp TZ=UTC USER=build
72026-03-03T18:57:00.064ZINFOtest_metrics: cockroach pid: 236950
82026-03-03T18:57:00.064ZINFOtest_metrics: cockroach listen URL: postgresql://root@[::1]:43291/omicron?sslmode=disable
92026-03-03T18:57:00.067ZDEBGtest_metrics (init_with_steps): Running step start_clickhouse
102026-03-03T18:57:00.069ZDEBGtest_metrics: Starting Clickhouse
112026-03-03T18:57:00.580ZDEBGtest_metrics (init_with_steps): Running step start_internal_dns
122026-03-03T18:57:00.580ZINFOtest_metrics (store): opening sled database path = /var/tmp/omicron_tmp/.tmpSRN1vv
132026-03-03T18:57:00.605ZINFOtest_metrics (store): pruning trees for generations newer than 0
142026-03-03T18:57:00.607ZINFOtest_metrics (store): pruning trees for generations older than 0 keep = 3
152026-03-03T18:57:00.607ZINFOtest_metrics (dns): DNS server bound to address kind = dns local_address = [::1]:45834
162026-03-03T18:57:00.607ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:34487 method = GET path = /config versions = all starting from 2.0.0
172026-03-03T18:57:00.607ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:34487 method = GET path = /config versions = from 1.0.0 to 2.0.0
182026-03-03T18:57:00.607ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:34487 method = PUT path = /config versions = all starting from 2.0.0
192026-03-03T18:57:00.607ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:34487 method = PUT path = /config versions = from 1.0.0 to 2.0.0
202026-03-03T18:57:00.607ZINFOtest_metrics (http): listening kind = dns local_addr = [::1]:34487
212026-03-03T18:57:00.607ZDEBGtest_metrics (http): successfully registered DTrace USDT probes kind = dns local_addr = [::1]:34487
222026-03-03T18:57:00.607ZDEBGtest_metrics (init_with_steps): Running step start_external_dns
232026-03-03T18:57:00.615ZINFOtest_metrics (store): opening sled database path = /var/tmp/omicron_tmp/.tmppE8igB
242026-03-03T18:57:00.615ZINFOtest_metrics (store): pruning trees for generations newer than 0
252026-03-03T18:57:00.615ZINFOtest_metrics (store): pruning trees for generations older than 0 keep = 3
262026-03-03T18:57:00.615ZINFOtest_metrics (dns): DNS server bound to address kind = dns local_address = [::1]:54483
272026-03-03T18:57:00.616ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:46173 method = GET path = /config versions = all starting from 2.0.0
282026-03-03T18:57:00.616ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:46173 method = GET path = /config versions = from 1.0.0 to 2.0.0
292026-03-03T18:57:00.616ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:46173 method = PUT path = /config versions = all starting from 2.0.0
302026-03-03T18:57:00.616ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:46173 method = PUT path = /config versions = from 1.0.0 to 2.0.0
312026-03-03T18:57:00.616ZINFOtest_metrics (http): listening kind = dns local_addr = [::1]:46173
322026-03-03T18:57:00.616ZDEBGtest_metrics (http): successfully registered DTrace USDT probes kind = dns local_addr = [::1]:46173
332026-03-03T18:57:00.616ZDEBGtest_metrics (init_with_steps): Running step start_nexus_internal
342026-03-03T18:57:00.616ZDEBGtest_metrics: Starting Nexus (internal API)
352026-03-03T18:57:00.616ZINFOtest_metrics: setting up nexus server
362026-03-03T18:57:00.616ZINFOtest_metrics (ServerContext): registering Oso class class = Action
372026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = AuditLog
382026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = AnyActor
392026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = AuthenticatedActor
402026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = BlueprintConfig
412026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Database
422026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = DnsConfig
432026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Fleet
442026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Inventory
452026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = IpPoolList
462026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = VpcList
472026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = ConsoleSessionList
482026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = DeviceAuthRequestList
492026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = QuiesceState
502026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SiloCertificateList
512026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SiloGroupList
522026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SiloIdentityProviderList
532026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SiloUserList
542026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SiloUserSessionList
552026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SiloUserTokenList
562026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SubnetPoolList
572026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = UpdateTrustRootList
582026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = TargetReleaseConfig
592026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = AlertClassList
602026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = ScimClientBearerTokenList
612026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = MulticastGroupList
622026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Project
632026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Disk
642026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Snapshot
652026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = ProjectImage
662026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = AffinityGroup
672026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = AntiAffinityGroup
682026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Instance
692026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = IpPool
702026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = InstanceNetworkInterface
712026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Vpc
722026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = VpcRouter
732026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = InternetGateway
742026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = InternetGatewayIpPool
752026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = InternetGatewayIpAddress
762026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = RouterRoute
772026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = VpcSubnet
782026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = FloatingIp
792026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = ExternalSubnet
802026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Image
812026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SiloImage
822026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = AddressLot
832026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Blueprint
842026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = LoopbackAddress
852026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Certificate
862026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = ConsoleSession
872026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = DeviceAuthRequest
882026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = DeviceAccessToken
892026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = PhysicalDisk
902026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Rack
912026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SshKey
922026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Silo
932026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SiloUser
942026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SiloGroup
952026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SupportBundle
962026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = IdentityProvider
972026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SamlIdentityProvider
982026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Sled
992026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = SubnetPool
1002026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = TufRepo
1012026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = TufArtifact
1022026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = TufTrustRoot
1032026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Alert
1042026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = AlertReceiver
1052026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = WebhookSecret
1062026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Zpool
1072026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = Service
1082026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = UserBuiltin
1092026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = ScimClientBearerToken
1102026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): registering Oso class class = MulticastGroup
1112026-03-03T18:57:00.617ZINFOtest_metrics (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations; grants project.admin on all projects)\n# - silo.limited-collaborator (grants project.limited-collaborator on all projects)\n# - silo.viewer (can read most resources within the Silo; grants project.viewer)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project, including networking)\n# - project.limited-collaborator (can manage compute resources, but not networking resources)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\n# Note that certain Actors may not ever have any roles assigned to them, like\n# SCIM Actors.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "limited-collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "limited-collaborator";\n\t"limited-collaborator" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif actor.is_user and silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "limited-collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t# Role hierarchy: admin > collaborator > limited-collaborator > viewer\n\t#\n\t# The "limited-collaborator" role can create/modify non-networking\n\t# resources (instances, disks, etc.) but cannot create/modify networking\n\t# infrastructure (VPCs, subnets, routers, internet gateways).\n\t# See nexus/authz-macros for InProjectLimited vs InProjectFull.\n\t"viewer" if "limited-collaborator";\n\t"limited-collaborator" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "limited-collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"limited-collaborator" if "limited-collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if actor.is_user and silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n}\n# We want to allow the user to modify the ssh key but disallow a SCIM IdP token\n# from doing the same.\nhas_permission(actor: AuthenticatedActor, "modify", ssh_key: SshKey)\n\tif actor.is_user and has_permission(actor, "modify", ssh_key.silo_user);\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource ScimClientBearerToken {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n # necessary to authenticate SCIM actors\n\t"read" if "external-authenticator" on "parent_fleet";\n\n\t# Silo-level roles grant privileges for SCIM client tokens.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges for SCIM client tokens.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", scim_client_bearer_token: ScimClientBearerToken)\n\tif scim_client_bearer_token.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: ScimClientBearerToken)\n\tif collection.silo.fleet = fleet;\n\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the quiesce state of a particular Nexus instance.\n#\n# These authz checks must not require the database. We grant this directly to\n# callers of the internal API.\nresource QuiesceState {\n\tpermissions = [ "read", "modify" ];\n}\nhas_permission(USER_INTERNAL_API: AuthenticatedActor, "read", _q: QuiesceState);\nhas_permission(\n USER_INTERNAL_API: AuthenticatedActor,\n "modify",\n _q: QuiesceState\n);\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/update/trust-roots" in the API\nresource UpdateTrustRootList {\n\tpermissions = [ "list_children", "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"list_children" if "viewer" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: UpdateTrustRootList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource TargetReleaseConfig {\n\tpermissions = [\n\t "read", # read the current target release\n\t "modify", # change the current target release\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", resource: TargetReleaseConfig)\n\tif resource.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif actor.is_user and silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for accessing "/v1/multicast-groups" in the API\n# Groups are created when the first instance joins and deleted when the last leaves.\nresource MulticastGroupList {\n\tpermissions = [ "list_children" ];\n\n\trelations = { parent_fleet: Fleet };\n\n\t# Fleet Viewers can list multicast groups\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", multicast_group_list: MulticastGroupList)\n\tif multicast_group_list.fleet = fleet;\n\n# Any authenticated user can list multicast groups in their fleet.\n# This enables silo users to discover groups for attaching instances,\n# without requiring the Fleet::Viewer role.\nhas_permission(actor: AuthenticatedActor, "list_children", multicast_group_list: MulticastGroupList)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group_list.fleet;\n\n# MulticastGroup is a fleet-level discovery resource.\n# Join/leave authorization is gated by Instance::Modify, not the group itself.\nresource MulticastGroup {\n\tpermissions = [ "read", "list_children" ];\n\trelations = { parent_fleet: Fleet };\n}\nhas_relation(fleet: Fleet, "parent_fleet", multicast_group: MulticastGroup)\n\tif multicast_group.fleet = fleet;\n\n# Any authenticated user can read multicast groups in their fleet\nhas_permission(actor: AuthenticatedActor, "read", multicast_group: MulticastGroup)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group.fleet;\n\n# Any authenticated user can list members of multicast groups in their fleet\nhas_permission(actor: AuthenticatedActor, "list_children", multicast_group: MulticastGroup)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group.fleet;\n\n# Describes the policy for reading and writing the audit log\nresource AuditLog {\n\tpermissions = [\n\t "list_children", # retrieve audit log\n\t "create_child", # create audit log entry\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\n\t# Fleet viewers can read the audit log\n\t"list_children" if "viewer" on "parent_fleet";\n}\n\n# Any actor should be able to write to the audit log because we need to be able\n# to write to the log from any request, authenticated or not. Audit log writes\n# are always a byproduct of other operations: there are no endpoints that allow\n# the user to write to the log deliberately. Note we use AuthenticatedActor\n# because we don't really mean unauthenticated -- in the case of login\n# operations, we use the external authenticator actor that creates the session\n# to authorize the audit log write.\nhas_permission(_actor: AuthenticatedActor, "create_child", _audit_log: AuditLog);\n\nhas_relation(fleet: Fleet, "parent_fleet", audit_log: AuditLog)\n\tif audit_log.fleet = fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Allow silo admins to delete and list user sessions\nresource SiloUserSessionList {\n permissions = [ "modify", "list_children" ];\n relations = { parent_silo: Silo };\n\n # A silo admin can modify (e.g., delete) a user's sessions.\n "modify" if "admin" on "parent_silo";\n\n # A silo admin can list a user's sessions.\n "list_children" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", authn_list: SiloUserSessionList)\n if authn_list.silo_user.silo = silo;\n\n# give users 'modify' and 'list_children' on their own sessions\nhas_permission(actor: AuthenticatedActor, "modify", authn_list: SiloUserSessionList)\n if actor.equals_silo_user(authn_list.silo_user);\nhas_permission(actor: AuthenticatedActor, "list_children", authn_list: SiloUserSessionList)\n if actor.equals_silo_user(authn_list.silo_user);\n\n# Allow silo admins to delete and list user access tokens\nresource SiloUserTokenList {\n permissions = [ "modify", "list_children" ];\n relations = { parent_silo: Silo };\n\n # A silo admin can modify (e.g., delete) a user's tokens.\n "modify" if "admin" on "parent_silo";\n\n # A silo admin can list a user's tokens.\n "list_children" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", authn_list: SiloUserTokenList)\n if authn_list.silo_user.silo = silo;\n\n# give users 'modify' and 'list_children' on their own tokens\nhas_permission(actor: AuthenticatedActor, "modify", authn_list: SiloUserTokenList)\n if actor.equals_silo_user(authn_list.silo_user);\nhas_permission(actor: AuthenticatedActor, "list_children", authn_list: SiloUserTokenList)\n if actor.equals_silo_user(authn_list.silo_user);\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# Grant SCIM IdP actors the permissions they need on users.\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if actor.is_scim_idp and silo_user.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "create_child", silo_user_list: SiloUserList)\n\tif actor.is_scim_idp and silo_user_list.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "modify", silo_user: SiloUser)\n\tif actor.is_scim_idp and silo_user.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "list_children", silo_user_list: SiloUserList)\n if actor.is_scim_idp and silo_user_list.silo in actor.silo;\n\n# Describes the policy for creating and managing Silo groups (mostly intended\n# for API-managed groups)\nresource SiloGroupList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the groups in the\n\t# Silo) can see the groups in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's groups. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloGroupList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloGroupList)\n\tif collection.silo.fleet = fleet;\n\n# Grant SCIM IdP actors the permissions they need on groups.\nhas_permission(actor: AuthenticatedActor, "read", silo_group: SiloGroup)\n if actor.is_scim_idp and silo_group.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "create_child", silo_group_list: SiloGroupList)\n\tif actor.is_scim_idp and silo_group_list.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "modify", silo_group: SiloGroup)\n\tif actor.is_scim_idp and silo_group.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "list_children", silo_group_list: SiloGroupList)\n if actor.is_scim_idp and silo_group_list.silo in actor.silo;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest)\n if actor.is_user;\nhas_permission(actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest)\n if actor.is_user;\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\nresource WebhookSecret {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_alert_receiver: AlertReceiver };\n\n\t"read" if "read" on "parent_alert_receiver";\n\t"modify" if "modify" on "parent_alert_receiver";\n}\n\nhas_relation(rx: AlertReceiver, "parent_alert_receiver", secret: WebhookSecret)\n\tif secret.alert_receiver = rx;\n\nresource AlertClassList {\n\tpermissions = [ "list_children" ];\n\trelations = { parent_fleet: Fleet };\n\n\t"list_children" if "viewer" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", collection: AlertClassList)\n\tif collection.fleet = fleet;\n\nresource ScimClientBearerTokenList {\n\tpermissions = [ "create_child", "list_children" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges for SCIM client tokens.\n # These are all admin because being able to create these tokens would allow\n # a user to grant themselves admin by modifying group membership through SCIM calls\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_silo";\n\n # Fleet-level roles also grant privileges for SCIM client tokens, for\n # configuration before silo admins are present.\n\t"create_child" if "admin" on "parent_fleet";\n\t"list_children" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", scim_client_bearer_token_list: ScimClientBearerTokenList)\n\tif scim_client_bearer_token_list.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: ScimClientBearerTokenList)\n\tif collection.silo.fleet = fleet;\n\n# VpcList is a synthetic resource for controlling VPC creation.\n# Unlike other project resources, VPC creation requires the full "collaborator"\n# role rather than "limited-collaborator", enforcing the networking restriction.\n# This allows organizations to restrict who can reconfigure the network topology\n# while still allowing users with limited-collaborator to work with compute\n# resources (instances, disks, etc.) within the existing network.\nresource VpcList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { containing_project: Project };\n\n\t"list_children" if "read" on "containing_project";\n\t"create_child" if "collaborator" on "containing_project";\n}\nhas_relation(project: Project, "containing_project", collection: VpcList)\n\tif collection.project = project;\n\n# Describes the policy for accessing "/v1/system/subnet-pools" in the API\nresource SubnetPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the Subnet Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list External Subnet Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", subnet_pool_list: SubnetPoolList)\n\tif subnet_pool_list.fleet = fleet;\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource AffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AffinityGroup)\n if child.project = parent;\n \n\n resource AntiAffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AntiAffinityGroup)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource ExternalSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ExternalSubnet)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n\n\n\n\n resource SupportBundle {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SupportBundle)\n if child.fleet = fleet;\n \n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource SubnetPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SubnetPool)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource TufTrustRoot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufTrustRoot)\n if child.fleet = fleet;\n \n\n resource Alert {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Alert)\n if child.fleet = fleet;\n \n\n resource AlertReceiver {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AlertReceiver)\n if child.fleet = fleet;\n \n\n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n \n\n
1122026-03-03T18:57:00.629ZINFOtest_metrics (ServerContext): Setting up resolver using DNS address: [::1]:45834
1132026-03-03T18:57:00.630ZINFOtest_metrics (DnsResolver): new DNS resolver addresses = [[::1]:45834]
1142026-03-03T18:57:00.630ZINFOtest_metrics (ServerContext): Setting up qorb database pool from a single host url = PostgresConfigWithUrl {\n url_raw: "postgresql://root@[::1]:43291/omicron?sslmode=disable",\n config: Config {\n user: Some(\n "root",\n ),\n password: None,\n dbname: Some(\n "omicron",\n ),\n options: None,\n application_name: None,\n ssl_mode: Disable,\n host: [\n Tcp(\n "::1",\n ),\n ],\n hostaddr: [],\n port: [\n 43291,\n ],\n connect_timeout: None,\n tcp_user_timeout: None,\n keepalives: true,\n keepalives_idle: 7200s,\n keepalives_interval: None,\n keepalives_retries: None,\n target_session_attrs: Any,\n channel_binding: Prefer,\n load_balance_hosts: Disable,\n },\n}
1152026-03-03T18:57:00.630ZDEBGtest_metrics (ServerContext): registered USDT probes
1162026-03-03T18:57:00.898ZINFOtest_metrics (datastore): Database schema version is up to date desired_version = 233.0.0 found_version = 233.0.0
1172026-03-03T18:57:00.901ZWARNtest_metrics (datastore): No db_metadata_nexus records exist - skipping access check explanation = This is expected during initial deployment or before migration nexus_id = 913233fe-92a8-4635-9572-183f495429c4 (omicron_zone)
1182026-03-03T18:57:00.908ZINFOtest_metrics (nexus): Datastore is ready for usage
1192026-03-03T18:57:00.958ZDEBGtest_metrics (clickhouse-client): registered USDT probes id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f
1202026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
1212026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
1222026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
1232026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
1242026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1252026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1262026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = PUT path = /disks/{disk_id} versions = all
1272026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = POST path = /metrics/collectors versions = all
1282026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1292026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = POST path = /metrics/producers versions = all
1302026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1312026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = GET path = /probes/{sled} versions = all
1322026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = POST path = /refresh-vpc-routes versions = all
1332026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = GET path = /sled-agents/{sled_id} versions = all
1342026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = POST path = /sled-agents/{sled_id} versions = all
1352026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = PUT path = /switch/{switch_id} versions = all
1362026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = GET path = /v1/ping versions = all
1372026-03-03T18:57:00.968ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = PUT path = /vmms/{propolis_id} versions = all
1382026-03-03T18:57:00.969ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:41339 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1392026-03-03T18:57:00.969ZINFOtest_metrics (dropshot_internal): listening local_addr = 127.0.0.1:41339
1402026-03-03T18:57:00.969ZDEBGtest_metrics (dropshot_internal): successfully registered DTrace USDT probes local_addr = 127.0.0.1:41339
1412026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /bgtasks versions = all
1422026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /bgtasks/activate versions = all
1432026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /bgtasks/view/{bgtask_name} versions = all
1442026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /clickhouse/policy versions = all
1452026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /clickhouse/policy versions = all
1462026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /debug/fetch-omdb-binary versions = all
1472026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /demo-saga versions = all
1482026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1492026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /deployment/blueprints/all versions = all
1502026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1512026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1522026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /deployment/blueprints/import versions = all
1532026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /deployment/blueprints/regenerate versions = all
1542026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /deployment/blueprints/target versions = all
1552026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /deployment/blueprints/target versions = all
1562026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = PUT path = /deployment/blueprints/target/enabled versions = all
1572026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /deployment/reconfigurator-config versions = all
1582026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /deployment/reconfigurator-config versions = all
1592026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /deployment/reconfigurator-config/{version} versions = all
1602026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /deployment/update-status versions = all
1612026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /experimental/v1/system/support-bundles versions = all
1622026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /experimental/v1/system/support-bundles versions = all
1632026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = DELETE path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
1642026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
1652026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = PUT path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
1662026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
1672026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
1682026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
1692026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
1702026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/index versions = all
1712026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /instances/{instance_id}/migrate versions = all
1722026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /mgs-updates versions = all
1732026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /oximeter/read-policy versions = all
1742026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /oximeter/read-policy versions = all
1752026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /physical-disk/expunge versions = all
1762026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /quiesce versions = all
1772026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /quiesce versions = all
1782026-03-03T18:57:00.970ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1792026-03-03T18:57:00.971ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /sagas versions = all
1802026-03-03T18:57:00.971ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /sagas/{saga_id} versions = all
1812026-03-03T18:57:00.971ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /sleds/expunge versions = all
1822026-03-03T18:57:00.971ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /sleds/uninitialized versions = all
1832026-03-03T18:57:00.971ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /trust-quorum/config/{rack_id} versions = all
1842026-03-03T18:57:00.971ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /trust-quorum/lrtq-upgrade versions = all
1852026-03-03T18:57:00.971ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = POST path = /trust-quorum/remove/{sled} versions = all
1862026-03-03T18:57:00.971ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:33961 method = GET path = /v1/ping versions = all
1872026-03-03T18:57:00.971ZINFOtest_metrics (dropshot_lockstep): listening local_addr = 127.0.0.1:33961
1882026-03-03T18:57:00.971ZDEBGtest_metrics (dropshot_lockstep): successfully registered DTrace USDT probes local_addr = 127.0.0.1:33961
1892026-03-03T18:57:00.971ZINFOtest_metrics (SEC): SEC running sec_id = 913233fe-92a8-4635-9572-183f495429c4
1902026-03-03T18:57:00.971ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
1912026-03-03T18:57:00.971ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
1922026-03-03T18:57:00.973ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
1932026-03-03T18:57:00.973ZDEBGtest_metrics (DataLoader): attempting to create built-in users
1942026-03-03T18:57:00.973ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
1952026-03-03T18:57:00.973ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
1962026-03-03T18:57:00.973ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
1972026-03-03T18:57:01.031ZINFOtest_metrics (MgsUpdateDriver): starting MgsUpdateDriver
1982026-03-03T18:57:01.033ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 43 33 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 C3..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:59483 req_id = dbea2388-e846-4c44-b867-2472a961fed8
1992026-03-03T18:57:01.034ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 17203,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:59483 req_id = dbea2388-e846-4c44-b867-2472a961fed8
2002026-03-03T18:57:01.034ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17203, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_mgs._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 4, 95, 109, 103, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_mgs._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:59483 req_id = dbea2388-e846-4c44-b867-2472a961fed8
2012026-03-03T18:57:01.034ZTRACtest_metrics (dns): buffer buffer = Length: 74 (0x4a) bytes\n0000: b0 f6 01 00 00 01 00 00 00 00 00 01 0b 5f 72 65 ............._re\n0010: 70 6f 2d 64 65 70 6f 74 04 5f 74 63 70 0d 63 6f po-depot._tcp.co\n0020: 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 ntrol-plane.oxid\n0030: 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 e.internal..!...\n0040: 00 29 04 d0 00 00 00 00 00 00 .)........ kind = dns peer_addr = [::1]:60018 req_id = d3f988a2-37ba-46f6-a098-c329340a4802
2022026-03-03T18:57:01.034ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 45302,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_repo-depot._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_repo-depot._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 11,\n 95,\n 114,\n 101,\n 112,\n 111,\n 45,\n 100,\n 101,\n 112,\n 111,\n 116,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:60018 req_id = d3f988a2-37ba-46f6-a098-c329340a4802
2032026-03-03T18:57:01.034ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45302, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_repo-depot._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_repo-depot._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 11, 95, 114, 101, 112, 111, 45, 100, 101, 112, 111, 116, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_repo-depot._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:60018 req_id = d3f988a2-37ba-46f6-a098-c329340a4802
2042026-03-03T18:57:01.034ZTRACtest_metrics (dns): buffer buffer = Length: 79 (0x4f) bytes\n0000: 74 25 01 00 00 01 00 00 00 00 00 01 10 5f 63 72 t%..........._cr\n0010: 75 63 69 62 6c 65 2d 70 61 6e 74 72 79 04 5f 74 ucible-pantry._t\n0020: 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 cp.control-plane\n0030: 05 6f 78 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 .oxide.internal.\n0040: 00 21 00 01 00 00 29 04 d0 00 00 00 00 00 00 .!....)........ kind = dns peer_addr = [::1]:49248 req_id = bbbeaf9c-55fe-46a6-9d4b-fc3a855fd3d0
2052026-03-03T18:57:01.034ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 29733,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 16,\n 95,\n 99,\n 114,\n 117,\n 99,\n 105,\n 98,\n 108,\n 101,\n 45,\n 112,\n 97,\n 110,\n 116,\n 114,\n 121,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:49248 req_id = bbbeaf9c-55fe-46a6-9d4b-fc3a855fd3d0
2062026-03-03T18:57:01.034ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 29733, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_crucible-pantry._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 16, 95, 99, 114, 117, 99, 105, 98, 108, 101, 45, 112, 97, 110, 116, 114, 121, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_crucible-pantry._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:49248 req_id = bbbeaf9c-55fe-46a6-9d4b-fc3a855fd3d0
2072026-03-03T18:57:01.054ZINFOtest_metrics (DataLoader): created 5 built-in users
2082026-03-03T18:57:01.054ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2092026-03-03T18:57:01.054ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2102026-03-03T18:57:01.054ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2112026-03-03T18:57:01.054ZDEBGtest_metrics (DataLoader): attempting to create built-in role assignments
2122026-03-03T18:57:01.054ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2132026-03-03T18:57:01.054ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2142026-03-03T18:57:01.054ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2152026-03-03T18:57:01.194ZINFOtest_metrics (DataLoader): created 4 built-in role assignments
2162026-03-03T18:57:01.194ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2172026-03-03T18:57:01.194ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2182026-03-03T18:57:01.195ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2192026-03-03T18:57:01.195ZDEBGtest_metrics (DataLoader): attempting to create built-in silos
2202026-03-03T18:57:01.195ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2212026-03-03T18:57:01.195ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2222026-03-03T18:57:01.196ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2232026-03-03T18:57:01.238ZINFOtest_metrics (DataLoader): created 2 built-in silos
2242026-03-03T18:57:01.239ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2252026-03-03T18:57:01.239ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2262026-03-03T18:57:01.239ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2272026-03-03T18:57:01.253ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2282026-03-03T18:57:01.253ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2292026-03-03T18:57:01.254ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2302026-03-03T18:57:01.255ZDEBGtest_metrics (DataLoader): attempting to create built-in projects
2312026-03-03T18:57:01.255ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2322026-03-03T18:57:01.255ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2332026-03-03T18:57:01.255ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2342026-03-03T18:57:01.258ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }
2352026-03-03T18:57:01.259ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2362026-03-03T18:57:01.259ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2372026-03-03T18:57:01.259ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2382026-03-03T18:57:01.259ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2392026-03-03T18:57:01.301ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2402026-03-03T18:57:01.301ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2412026-03-03T18:57:01.301ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2422026-03-03T18:57:01.302ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2432026-03-03T18:57:01.303ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2442026-03-03T18:57:01.305ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
2452026-03-03T18:57:01.305ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }
2462026-03-03T18:57:01.305ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2472026-03-03T18:57:01.307ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2482026-03-03T18:57:01.307ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2492026-03-03T18:57:01.307ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2502026-03-03T18:57:01.307ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2512026-03-03T18:57:01.307ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2522026-03-03T18:57:01.307ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2532026-03-03T18:57:01.307ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2542026-03-03T18:57:01.308ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2552026-03-03T18:57:01.310ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
2562026-03-03T18:57:01.311ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2572026-03-03T18:57:01.311ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2582026-03-03T18:57:01.311ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2592026-03-03T18:57:01.318ZINFOtest_metrics (DataLoader): created built-in services project
2602026-03-03T18:57:01.318ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2612026-03-03T18:57:01.318ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2622026-03-03T18:57:01.319ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2632026-03-03T18:57:01.321ZDEBGtest_metrics (DataLoader): attempting to create built-in VPCs
2642026-03-03T18:57:01.321ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2652026-03-03T18:57:01.321ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2662026-03-03T18:57:01.321ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2672026-03-03T18:57:01.321ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2682026-03-03T18:57:01.321ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2692026-03-03T18:57:01.323ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2702026-03-03T18:57:01.324ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }
2712026-03-03T18:57:01.326ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
2722026-03-03T18:57:01.326ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2732026-03-03T18:57:01.326ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2742026-03-03T18:57:01.326ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2752026-03-03T18:57:01.329ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2762026-03-03T18:57:01.329ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2772026-03-03T18:57:01.329ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2782026-03-03T18:57:01.330ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2792026-03-03T18:57:01.333ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2802026-03-03T18:57:01.334ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2812026-03-03T18:57:01.334ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2822026-03-03T18:57:01.334ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2832026-03-03T18:57:01.334ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2842026-03-03T18:57:01.337ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2852026-03-03T18:57:01.337ZTRACtest_metrics (DataLoader): successful lookup of siloed resource "Project" using built-in user
2862026-03-03T18:57:01.338ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }
2872026-03-03T18:57:01.338ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
2882026-03-03T18:57:01.338ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2892026-03-03T18:57:01.338ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2902026-03-03T18:57:01.338ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2912026-03-03T18:57:01.339ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2922026-03-03T18:57:01.339ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2932026-03-03T18:57:01.339ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2942026-03-03T18:57:01.340ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2952026-03-03T18:57:01.341ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2962026-03-03T18:57:01.342ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2972026-03-03T18:57:01.343ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2982026-03-03T18:57:01.343ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2992026-03-03T18:57:01.343ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3002026-03-03T18:57:01.350ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
3012026-03-03T18:57:01.351ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3022026-03-03T18:57:01.351ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3032026-03-03T18:57:01.351ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3042026-03-03T18:57:01.357ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }
3052026-03-03T18:57:01.357ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3062026-03-03T18:57:01.357ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3072026-03-03T18:57:01.357ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3082026-03-03T18:57:01.357ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3092026-03-03T18:57:01.364ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3102026-03-03T18:57:01.365ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3112026-03-03T18:57:01.365ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3122026-03-03T18:57:01.365ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3132026-03-03T18:57:01.367ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3142026-03-03T18:57:01.370ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3152026-03-03T18:57:01.370ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3162026-03-03T18:57:01.370ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3172026-03-03T18:57:01.370ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3182026-03-03T18:57:01.374ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
3192026-03-03T18:57:01.375ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3202026-03-03T18:57:01.375ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3212026-03-03T18:57:01.375ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3222026-03-03T18:57:01.378ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3232026-03-03T18:57:01.379ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3242026-03-03T18:57:01.379ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3252026-03-03T18:57:01.381ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3262026-03-03T18:57:01.381ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3272026-03-03T18:57:01.382ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3282026-03-03T18:57:01.383ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }
3292026-03-03T18:57:01.384ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3302026-03-03T18:57:01.384ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3312026-03-03T18:57:01.384ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3322026-03-03T18:57:01.384ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3332026-03-03T18:57:01.385ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3342026-03-03T18:57:01.385ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3352026-03-03T18:57:01.385ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3362026-03-03T18:57:01.386ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3372026-03-03T18:57:01.387ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3382026-03-03T18:57:01.387ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3392026-03-03T18:57:01.387ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3402026-03-03T18:57:01.387ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3412026-03-03T18:57:01.388ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3422026-03-03T18:57:01.392ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
3432026-03-03T18:57:01.392ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3442026-03-03T18:57:01.392ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3452026-03-03T18:57:01.392ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3462026-03-03T18:57:01.431ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
3472026-03-03T18:57:01.431ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3482026-03-03T18:57:01.431ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3492026-03-03T18:57:01.431ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3502026-03-03T18:57:01.432ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3512026-03-03T18:57:01.433ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3522026-03-03T18:57:01.433ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3532026-03-03T18:57:01.433ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3542026-03-03T18:57:01.434ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3552026-03-03T18:57:01.435ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3562026-03-03T18:57:01.435ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3572026-03-03T18:57:01.435ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3582026-03-03T18:57:01.435ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3592026-03-03T18:57:01.436ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3602026-03-03T18:57:01.440ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3612026-03-03T18:57:01.440ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3622026-03-03T18:57:01.440ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3632026-03-03T18:57:01.441ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3642026-03-03T18:57:01.480ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
3652026-03-03T18:57:01.480ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3662026-03-03T18:57:01.480ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3672026-03-03T18:57:01.480ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3682026-03-03T18:57:01.480ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3692026-03-03T18:57:01.482ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3702026-03-03T18:57:01.482ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3712026-03-03T18:57:01.482ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3722026-03-03T18:57:01.482ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3732026-03-03T18:57:01.483ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3742026-03-03T18:57:01.483ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3752026-03-03T18:57:01.483ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3762026-03-03T18:57:01.484ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3772026-03-03T18:57:01.485ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3782026-03-03T18:57:01.491ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3792026-03-03T18:57:01.491ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3802026-03-03T18:57:01.491ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3812026-03-03T18:57:01.491ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3822026-03-03T18:57:01.499ZDEBGtest_metrics (DataLoader): attempting to create built-in VPC firewall rules
3832026-03-03T18:57:01.499ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3842026-03-03T18:57:01.499ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3852026-03-03T18:57:01.500ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3862026-03-03T18:57:01.505ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3872026-03-03T18:57:01.505ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3882026-03-03T18:57:01.505ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3892026-03-03T18:57:01.506ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3902026-03-03T18:57:01.506ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3912026-03-03T18:57:01.507ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3922026-03-03T18:57:01.508ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
3932026-03-03T18:57:01.508ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3942026-03-03T18:57:01.508ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3952026-03-03T18:57:01.508ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3962026-03-03T18:57:01.509ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3972026-03-03T18:57:01.509ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3982026-03-03T18:57:01.509ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3992026-03-03T18:57:01.510ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4002026-03-03T18:57:01.510ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4012026-03-03T18:57:01.511ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4022026-03-03T18:57:01.511ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4032026-03-03T18:57:01.511ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4042026-03-03T18:57:01.511ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4052026-03-03T18:57:01.512ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4062026-03-03T18:57:01.527ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4072026-03-03T18:57:01.527ZTRACtest_metrics (DataLoader): successful lookup of siloed resource "Vpc" using built-in user
4082026-03-03T18:57:01.527ZTRACtest_metrics (DataLoader): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4092026-03-03T18:57:01.527ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4102026-03-03T18:57:01.527ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4112026-03-03T18:57:01.527ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4122026-03-03T18:57:01.528ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4132026-03-03T18:57:01.530ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4142026-03-03T18:57:01.530ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4152026-03-03T18:57:01.530ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4162026-03-03T18:57:01.530ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4172026-03-03T18:57:01.531ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4182026-03-03T18:57:01.531ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4192026-03-03T18:57:01.531ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4202026-03-03T18:57:01.532ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4212026-03-03T18:57:01.533ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4222026-03-03T18:57:01.538ZDEBGtest_metrics (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4232026-03-03T18:57:01.538ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4242026-03-03T18:57:01.538ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4252026-03-03T18:57:01.538ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4262026-03-03T18:57:01.542ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4272026-03-03T18:57:01.542ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4282026-03-03T18:57:01.542ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4292026-03-03T18:57:01.542ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4302026-03-03T18:57:01.542ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4312026-03-03T18:57:01.545ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4322026-03-03T18:57:01.545ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4332026-03-03T18:57:01.545ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4342026-03-03T18:57:01.545ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4352026-03-03T18:57:01.546ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4362026-03-03T18:57:01.547ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4372026-03-03T18:57:01.547ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4382026-03-03T18:57:01.547ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4392026-03-03T18:57:01.554ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4402026-03-03T18:57:01.558ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4412026-03-03T18:57:01.558ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4422026-03-03T18:57:01.558ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4432026-03-03T18:57:01.559ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4442026-03-03T18:57:01.603ZINFOtest_metrics (DataLoader): created built-in VPC firewall rules
4452026-03-03T18:57:01.603ZDEBGtest_metrics (DataLoader): attempting to create built-in VPC Subnets
4462026-03-03T18:57:01.603ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4472026-03-03T18:57:01.603ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4482026-03-03T18:57:01.604ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4492026-03-03T18:57:01.606ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4502026-03-03T18:57:01.606ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4512026-03-03T18:57:01.608ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4522026-03-03T18:57:01.609ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4532026-03-03T18:57:01.609ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4542026-03-03T18:57:01.609ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4552026-03-03T18:57:01.625ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4562026-03-03T18:57:01.625ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4572026-03-03T18:57:01.625ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4582026-03-03T18:57:01.625ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4592026-03-03T18:57:01.625ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4602026-03-03T18:57:01.627ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4612026-03-03T18:57:01.627ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4622026-03-03T18:57:01.627ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4632026-03-03T18:57:01.628ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4642026-03-03T18:57:01.629ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4652026-03-03T18:57:01.629ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4662026-03-03T18:57:01.629ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4672026-03-03T18:57:01.630ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4682026-03-03T18:57:01.631ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4692026-03-03T18:57:01.638ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4702026-03-03T18:57:01.638ZTRACtest_metrics (DataLoader): successful lookup of siloed resource "Vpc" using built-in user
4712026-03-03T18:57:01.638ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4722026-03-03T18:57:01.638ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4732026-03-03T18:57:01.640ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4742026-03-03T18:57:01.646ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4752026-03-03T18:57:01.646ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4762026-03-03T18:57:01.646ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4772026-03-03T18:57:01.646ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4782026-03-03T18:57:01.647ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4792026-03-03T18:57:01.648ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4802026-03-03T18:57:01.648ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4812026-03-03T18:57:01.648ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4822026-03-03T18:57:01.649ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4832026-03-03T18:57:01.657ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4842026-03-03T18:57:01.657ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4852026-03-03T18:57:01.657ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4862026-03-03T18:57:01.658ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4872026-03-03T18:57:01.659ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4882026-03-03T18:57:01.663ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4892026-03-03T18:57:01.666ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
4902026-03-03T18:57:01.666ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4912026-03-03T18:57:01.666ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4922026-03-03T18:57:01.666ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4932026-03-03T18:57:01.667ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4942026-03-03T18:57:01.668ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4952026-03-03T18:57:01.668ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4962026-03-03T18:57:01.668ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4972026-03-03T18:57:01.668ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4982026-03-03T18:57:01.670ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4992026-03-03T18:57:01.670ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5002026-03-03T18:57:01.670ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5012026-03-03T18:57:01.670ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5022026-03-03T18:57:01.671ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5032026-03-03T18:57:01.677ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
5042026-03-03T18:57:01.678ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5052026-03-03T18:57:01.678ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5062026-03-03T18:57:01.678ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5072026-03-03T18:57:01.684ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5082026-03-03T18:57:01.684ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5092026-03-03T18:57:01.685ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5102026-03-03T18:57:01.687ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
5112026-03-03T18:57:01.687ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5122026-03-03T18:57:01.687ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5132026-03-03T18:57:01.687ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5142026-03-03T18:57:01.687ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5152026-03-03T18:57:01.692ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5162026-03-03T18:57:01.692ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5172026-03-03T18:57:01.692ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5182026-03-03T18:57:01.692ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5192026-03-03T18:57:01.694ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5202026-03-03T18:57:01.694ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5212026-03-03T18:57:01.694ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5222026-03-03T18:57:01.694ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5232026-03-03T18:57:01.696ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5242026-03-03T18:57:01.700ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5252026-03-03T18:57:01.710ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
5262026-03-03T18:57:01.710ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5272026-03-03T18:57:01.710ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5282026-03-03T18:57:01.710ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5292026-03-03T18:57:01.710ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5302026-03-03T18:57:01.746ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5312026-03-03T18:57:01.746ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5322026-03-03T18:57:01.746ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5332026-03-03T18:57:01.746ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5342026-03-03T18:57:01.747ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5352026-03-03T18:57:01.747ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5362026-03-03T18:57:01.747ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5372026-03-03T18:57:01.747ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5382026-03-03T18:57:01.748ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5392026-03-03T18:57:01.752ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
5402026-03-03T18:57:01.753ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5412026-03-03T18:57:01.753ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5422026-03-03T18:57:01.753ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5432026-03-03T18:57:01.781ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5442026-03-03T18:57:01.781ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5452026-03-03T18:57:01.785ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5462026-03-03T18:57:01.797ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
5472026-03-03T18:57:01.797ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5482026-03-03T18:57:01.797ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5492026-03-03T18:57:01.797ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5502026-03-03T18:57:01.797ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5512026-03-03T18:57:01.797ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5522026-03-03T18:57:01.797ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5532026-03-03T18:57:01.797ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5542026-03-03T18:57:01.797ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5552026-03-03T18:57:01.797ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5562026-03-03T18:57:01.797ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5572026-03-03T18:57:01.797ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5582026-03-03T18:57:01.797ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5592026-03-03T18:57:01.797ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5602026-03-03T18:57:01.799ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5612026-03-03T18:57:01.803ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
5622026-03-03T18:57:01.803ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5632026-03-03T18:57:01.803ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5642026-03-03T18:57:01.803ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5652026-03-03T18:57:01.803ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5662026-03-03T18:57:01.804ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5672026-03-03T18:57:01.805ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5682026-03-03T18:57:01.805ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5692026-03-03T18:57:01.805ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5702026-03-03T18:57:01.806ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5712026-03-03T18:57:01.806ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5722026-03-03T18:57:01.806ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5732026-03-03T18:57:01.806ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5742026-03-03T18:57:01.807ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5752026-03-03T18:57:01.811ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
5762026-03-03T18:57:01.812ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5772026-03-03T18:57:01.812ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5782026-03-03T18:57:01.812ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5792026-03-03T18:57:01.814ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5802026-03-03T18:57:01.814ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5812026-03-03T18:57:01.815ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5822026-03-03T18:57:01.816ZINFOtest_metrics (DataLoader): created built-in services vpc subnets
5832026-03-03T18:57:01.816ZINFOtest_metrics (DataLoader): created built-in services vpc
5842026-03-03T18:57:01.816ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5852026-03-03T18:57:01.816ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5862026-03-03T18:57:01.818ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5872026-03-03T18:57:01.818ZDEBGtest_metrics (DataLoader): attempting to create silo users
5882026-03-03T18:57:01.818ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5892026-03-03T18:57:01.818ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5902026-03-03T18:57:01.818ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5912026-03-03T18:57:01.821ZINFOtest_metrics (DataLoader): created 2 silo users
5922026-03-03T18:57:01.821ZDEBGtest_metrics (DataLoader): attempting to create silo user role assignments
5932026-03-03T18:57:01.821ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5942026-03-03T18:57:01.821ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5952026-03-03T18:57:01.822ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5962026-03-03T18:57:01.823ZINFOtest_metrics (DataLoader): created 2 silo user role assignments
5972026-03-03T18:57:01.823ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5982026-03-03T18:57:01.823ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5992026-03-03T18:57:01.824ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6002026-03-03T18:57:01.826ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6012026-03-03T18:57:01.826ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6022026-03-03T18:57:01.826ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6032026-03-03T18:57:01.829ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = IpPoolList
6042026-03-03T18:57:01.829ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6052026-03-03T18:57:01.829ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6062026-03-03T18:57:01.829ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6072026-03-03T18:57:01.830ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6082026-03-03T18:57:01.831ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6092026-03-03T18:57:01.832ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = IpPoolList result = Ok(())
6102026-03-03T18:57:01.832ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6112026-03-03T18:57:01.832ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6122026-03-03T18:57:01.832ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6132026-03-03T18:57:01.938ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = IpPoolList
6142026-03-03T18:57:01.938ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6152026-03-03T18:57:01.938ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6162026-03-03T18:57:01.938ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6172026-03-03T18:57:01.938ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6182026-03-03T18:57:01.939ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6192026-03-03T18:57:01.941ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = IpPoolList result = Ok(())
6202026-03-03T18:57:01.941ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6212026-03-03T18:57:01.941ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6222026-03-03T18:57:01.941ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6232026-03-03T18:57:01.943ZINFOtest_metrics (nexus): populate complete
6242026-03-03T18:57:01.943ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig
6252026-03-03T18:57:01.943ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6262026-03-03T18:57:01.943ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
6272026-03-03T18:57:01.943ZDEBGtest_metrics (BackgroundTasks): roles roles = RoleSet { roles: {} }
6282026-03-03T18:57:01.943ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
6292026-03-03T18:57:01.955ZDEBGtest_metrics (init_with_steps): Running step start_gateway_switch0
6302026-03-03T18:57:01.955ZDEBGtest_metrics: Starting Management Gateway
6312026-03-03T18:57:01.996ZDEBGtest_metrics (BackgroundTasks): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6322026-03-03T18:57:02.000ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig result = Ok(())
6332026-03-03T18:57:02.000ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
6342026-03-03T18:57:02.000ZDEBGtest_metrics (BackgroundTasks): roles roles = RoleSet { roles: {} }
6352026-03-03T18:57:02.000ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
6362026-03-03T18:57:02.004ZINFOtest_metrics (nexus): activating background tasks
6372026-03-03T18:57:02.006ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
6382026-03-03T18:57:02.006ZDEBGtest_metrics (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
6392026-03-03T18:57:02.006ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
6402026-03-03T18:57:02.007ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6412026-03-03T18:57:02.007ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6422026-03-03T18:57:02.009ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
6432026-03-03T18:57:02.009ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal
6442026-03-03T18:57:02.009ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
6452026-03-03T18:57:02.009ZWARNtest_metrics (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal reason = no config nor servers
6462026-03-03T18:57:02.009ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 51.63\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
6472026-03-03T18:57:02.009ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
6482026-03-03T18:57:02.009ZDEBGtest_metrics (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
6492026-03-03T18:57:02.009ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
6502026-03-03T18:57:02.009ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6512026-03-03T18:57:02.010ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6522026-03-03T18:57:02.010ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
6532026-03-03T18:57:02.010ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal
6542026-03-03T18:57:02.010ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
6552026-03-03T18:57:02.010ZWARNtest_metrics (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external reason = no config nor servers
6562026-03-03T18:57:02.010ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 16.27\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
6572026-03-03T18:57:02.010ZDEBGtest_metrics (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
6582026-03-03T18:57:02.010ZINFOtest_metrics (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2026-03-03 18:47:02.010725198 UTC
6592026-03-03T18:57:02.010ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database
6602026-03-03T18:57:02.010ZDEBGtest_metrics (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
6612026-03-03T18:57:02.011ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
6622026-03-03T18:57:02.011ZDEBGtest_metrics (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
6632026-03-03T18:57:02.011ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet
6642026-03-03T18:57:02.011ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6652026-03-03T18:57:02.011ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
6662026-03-03T18:57:02.011ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6672026-03-03T18:57:02.011ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
6682026-03-03T18:57:02.012ZDEBGtest_metrics (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 1 reason = Timeout
6692026-03-03T18:57:02.012ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database
6702026-03-03T18:57:02.012ZDEBGtest_metrics (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
6712026-03-03T18:57:02.012ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
6722026-03-03T18:57:02.013ZDEBGtest_metrics (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
6732026-03-03T18:57:02.013ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = bfd_manager resource = Database
6742026-03-03T18:57:02.013ZDEBGtest_metrics (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6752026-03-03T18:57:02.013ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = bfd_manager resource = Database result = Ok(())
6762026-03-03T18:57:02.013ZDEBGtest_metrics (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
6772026-03-03T18:57:02.013ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
6782026-03-03T18:57:02.013ZWARNtest_metrics (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor reason = no blueprint
6792026-03-03T18:57:02.013ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 57.88\u{b5}s iteration = 1 status = {"error":"no blueprint"}
6802026-03-03T18:57:02.013ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
6812026-03-03T18:57:02.013ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
6822026-03-03T18:57:02.013ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6832026-03-03T18:57:02.014ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
6842026-03-03T18:57:02.014ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6852026-03-03T18:57:02.014ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
6862026-03-03T18:57:02.014ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 1 reason = Timeout
6872026-03-03T18:57:02.014ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
6882026-03-03T18:57:02.014ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6892026-03-03T18:57:02.014ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
6902026-03-03T18:57:02.014ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
6912026-03-03T18:57:02.014ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
6922026-03-03T18:57:02.015ZDEBGtest_metrics (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 1 reason = Timeout
6932026-03-03T18:57:02.015ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig
6942026-03-03T18:57:02.015ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = reconfigurator_config_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6952026-03-03T18:57:02.015ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
6962026-03-03T18:57:02.015ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
6972026-03-03T18:57:02.015ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
6982026-03-03T18:57:02.017ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 1 reason = Timeout
6992026-03-03T18:57:02.017ZDEBGtest_metrics (BackgroundTasks): reconfigurator config not yet loaded; doing nothing background_task = blueprint_planner
7002026-03-03T18:57:02.017ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 16.57\u{b5}s iteration = 1 status = "Disabled"
7012026-03-03T18:57:02.017ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
7022026-03-03T18:57:02.017ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig
7032026-03-03T18:57:02.017ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7042026-03-03T18:57:02.017ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
7052026-03-03T18:57:02.017ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7062026-03-03T18:57:02.017ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
7072026-03-03T18:57:02.017ZDEBGtest_metrics (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
7082026-03-03T18:57:02.017ZWARNtest_metrics (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector reason = no blueprint
7092026-03-03T18:57:02.017ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 13.45\u{b5}s iteration = 1 status = {"error":"no blueprint"}
7102026-03-03T18:57:02.017ZDEBGtest_metrics (BackgroundTasks): activating background_task = support_bundle_collector iteration = 1 reason = Timeout
7112026-03-03T18:57:02.017ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet
7122026-03-03T18:57:02.017ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = support_bundle_collector resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7132026-03-03T18:57:02.017ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database
7142026-03-03T18:57:02.018ZDEBGtest_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7152026-03-03T18:57:02.018ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7162026-03-03T18:57:02.018ZDEBGtest_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
7172026-03-03T18:57:02.018ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 12.01\u{b5}s iteration = 1 status = {"error":"task disabled"}
7182026-03-03T18:57:02.018ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 1 reason = Timeout
7192026-03-03T18:57:02.018ZWARNtest_metrics (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous reason = no blueprint
7202026-03-03T18:57:02.018ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 10.05\u{b5}s iteration = 1 status = {"error":"no blueprint"}
7212026-03-03T18:57:02.018ZDEBGtest_metrics (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
7222026-03-03T18:57:02.018ZINFOtest_metrics (BackgroundTasks): Decommissioned Disk Cleaner disabled background_task = decommissioned_disk_cleaner
7232026-03-03T18:57:02.018ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 17.24\u{b5}s iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7242026-03-03T18:57:02.018ZDEBGtest_metrics (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
7252026-03-03T18:57:02.018ZWARNtest_metrics (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker
7262026-03-03T18:57:02.018ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 8.09\u{b5}s iteration = 1 status = {"error":"inventory collection is None"}
7272026-03-03T18:57:02.018ZDEBGtest_metrics (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
7282026-03-03T18:57:02.018ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet
7292026-03-03T18:57:02.018ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = switch_port_config_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7302026-03-03T18:57:02.018ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database
7312026-03-03T18:57:02.018ZDEBGtest_metrics (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7322026-03-03T18:57:02.018ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7332026-03-03T18:57:02.019ZDEBGtest_metrics (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
7342026-03-03T18:57:02.019ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
7352026-03-03T18:57:02.019ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7362026-03-03T18:57:02.019ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
7372026-03-03T18:57:02.019ZDEBGtest_metrics (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
7382026-03-03T18:57:02.019ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database
7392026-03-03T18:57:02.019ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7402026-03-03T18:57:02.020ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
7412026-03-03T18:57:02.020ZDEBGtest_metrics (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
7422026-03-03T18:57:02.020ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database
7432026-03-03T18:57:02.020ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7442026-03-03T18:57:02.020ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7452026-03-03T18:57:02.020ZDEBGtest_metrics (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
7462026-03-03T18:57:02.020ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet
7472026-03-03T18:57:02.020ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = instance_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7482026-03-03T18:57:02.020ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database
7492026-03-03T18:57:02.020ZDEBGtest_metrics (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7502026-03-03T18:57:02.021ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
7512026-03-03T18:57:02.021ZDEBGtest_metrics (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
7522026-03-03T18:57:02.021ZINFOtest_metrics (BackgroundTasks): background instance updater explicitly disabled background_task = instance_updater
7532026-03-03T18:57:02.021ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = instance_updater elapsed = 70.34\u{b5}s iteration = 1 status = {"destroyed_active_vmms":0,"disabled":true,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7542026-03-03T18:57:02.021ZDEBGtest_metrics (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
7552026-03-03T18:57:02.021ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database
7562026-03-03T18:57:02.021ZDEBGtest_metrics (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
7572026-03-03T18:57:02.021ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
7582026-03-03T18:57:02.021ZDEBGtest_metrics (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
7592026-03-03T18:57:02.021ZDEBGtest_metrics (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
7602026-03-03T18:57:02.021ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
7612026-03-03T18:57:02.021ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622026-03-03T18:57:02.022ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632026-03-03T18:57:02.022ZDEBGtest_metrics (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
7642026-03-03T18:57:02.022ZINFOtest_metrics (BackgroundTasks): VPC route manager running background_task = vpc_route_manager
7652026-03-03T18:57:02.022ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
7662026-03-03T18:57:02.022ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7672026-03-03T18:57:02.022ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
7682026-03-03T18:57:02.022ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7692026-03-03T18:57:02.022ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7702026-03-03T18:57:02.022ZDEBGtest_metrics (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
7712026-03-03T18:57:02.022ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database
7722026-03-03T18:57:02.022ZDEBGtest_metrics (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
7732026-03-03T18:57:02.023ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
7742026-03-03T18:57:02.023ZDEBGtest_metrics (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
7752026-03-03T18:57:02.023ZINFOtest_metrics (SagaQuiesceHandle): saga recovery pass starting
7762026-03-03T18:57:02.023ZDEBGtest_metrics (SagaRecoverer): listing candidate sagas for recovery
7772026-03-03T18:57:02.023ZTRACtest_metrics (SagaRecoverer): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a (built_in_user), .. }) resource = Database
7782026-03-03T18:57:02.023ZDEBGtest_metrics (SagaRecoverer): roles roles = RoleSet { roles: {} }
7792026-03-03T18:57:02.023ZDEBGtest_metrics (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a (built_in_user), .. }) resource = Database result = Ok(())
7802026-03-03T18:57:02.023ZDEBGtest_metrics (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
7812026-03-03T18:57:02.023ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database
7822026-03-03T18:57:02.024ZDEBGtest_metrics (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
7832026-03-03T18:57:02.024ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
7842026-03-03T18:57:02.024ZDEBGtest_metrics (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
7852026-03-03T18:57:02.024ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database
7862026-03-03T18:57:02.024ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7872026-03-03T18:57:02.024ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7882026-03-03T18:57:02.024ZDEBGtest_metrics (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
7892026-03-03T18:57:02.024ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database
7902026-03-03T18:57:02.024ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
7912026-03-03T18:57:02.025ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7922026-03-03T18:57:02.025ZDEBGtest_metrics (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
7932026-03-03T18:57:02.025ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database
7942026-03-03T18:57:02.025ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7952026-03-03T18:57:02.025ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7962026-03-03T18:57:02.025ZDEBGtest_metrics (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
7972026-03-03T18:57:02.025ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database
7982026-03-03T18:57:02.025ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7992026-03-03T18:57:02.026ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
8002026-03-03T18:57:02.026ZDEBGtest_metrics (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 1 reason = Timeout
8012026-03-03T18:57:02.026ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
8022026-03-03T18:57:02.026ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8032026-03-03T18:57:02.026ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
8042026-03-03T18:57:02.026ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
8052026-03-03T18:57:02.026ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
8062026-03-03T18:57:02.026ZDEBGtest_metrics (BackgroundTasks): activating background_task = tuf_repo_pruner iteration = 1 reason = Timeout
8072026-03-03T18:57:02.026ZINFOtest_metrics (BackgroundTasks): reconfigurator config not yet loaded; doing nothing background_task = tuf_repo_pruner
8082026-03-03T18:57:02.026ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = tuf_repo_pruner elapsed = 29.39\u{b5}s iteration = 1 status = {"reason":"reconfigurator config not yet loaded","status":"disabled"}
8092026-03-03T18:57:02.026ZDEBGtest_metrics (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 1 reason = Timeout
8102026-03-03T18:57:02.026ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database
8112026-03-03T18:57:02.026ZDEBGtest_metrics (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
8122026-03-03T18:57:02.027ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
8132026-03-03T18:57:02.027ZDEBGtest_metrics (BackgroundTasks): activating background_task = alert_dispatcher iteration = 1 reason = Timeout
8142026-03-03T18:57:02.027ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database
8152026-03-03T18:57:02.027ZDEBGtest_metrics (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
8162026-03-03T18:57:02.027ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
8172026-03-03T18:57:02.027ZDEBGtest_metrics (BackgroundTasks): activating background_task = webhook_deliverator iteration = 1 reason = Timeout
8182026-03-03T18:57:02.027ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database
8192026-03-03T18:57:02.027ZDEBGtest_metrics (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
8202026-03-03T18:57:02.028ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
8212026-03-03T18:57:02.028ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 1 reason = Timeout
8222026-03-03T18:57:02.028ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
8232026-03-03T18:57:02.028ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
8242026-03-03T18:57:02.028ZDEBGtest_metrics (BackgroundTasks): skipping cache invalidation check: no inventory available background_task = multicast_reconciler
8252026-03-03T18:57:02.028ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
8262026-03-03T18:57:02.028ZDEBGtest_metrics (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 1 reason = Timeout
8272026-03-03T18:57:02.028ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
8282026-03-03T18:57:02.028ZDEBGtest_metrics (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 1 reason = Timeout
8292026-03-03T18:57:02.028ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet
8302026-03-03T18:57:02.028ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = fm_sitrep_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8312026-03-03T18:57:02.028ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database
8322026-03-03T18:57:02.028ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
8332026-03-03T18:57:02.029ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
8342026-03-03T18:57:02.029ZDEBGtest_metrics (BackgroundTasks): activating background_task = fm_sitrep_gc iteration = 1 reason = Timeout
8352026-03-03T18:57:02.029ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database
8362026-03-03T18:57:02.029ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
8372026-03-03T18:57:02.029ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
8382026-03-03T18:57:02.029ZDEBGtest_metrics (BackgroundTasks): activating background_task = probe_distributor iteration = 1 reason = Timeout
8392026-03-03T18:57:02.029ZINFOtest_metrics (BackgroundTasks): distributing networking probes to sleds background_task = probe_distributor
8402026-03-03T18:57:02.029ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet
8412026-03-03T18:57:02.029ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = probe_distributor resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8422026-03-03T18:57:02.029ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database
8432026-03-03T18:57:02.029ZDEBGtest_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
8442026-03-03T18:57:02.030ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
8452026-03-03T18:57:02.030ZDEBGtest_metrics (BackgroundTasks): activating background_task = trust_quorum_manager iteration = 1 reason = Timeout
8462026-03-03T18:57:02.030ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet
8472026-03-03T18:57:02.030ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = trust_quorum_manager bgtask = TrustQuorumManager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8482026-03-03T18:57:02.030ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database
8492026-03-03T18:57:02.030ZDEBGtest_metrics (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
8502026-03-03T18:57:02.030ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
8512026-03-03T18:57:02.030ZDEBGtest_metrics (BackgroundTasks): activating background_task = attached_subnet_manager iteration = 1 reason = Timeout
8522026-03-03T18:57:02.030ZINFOtest_metrics (BackgroundTasks): starting attached subnet manager work background_task = attached_subnet_manager
8532026-03-03T18:57:02.030ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
8542026-03-03T18:57:02.031ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
8552026-03-03T18:57:02.031ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8562026-03-03T18:57:02.031ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
8572026-03-03T18:57:02.031ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8582026-03-03T18:57:02.032ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8592026-03-03T18:57:02.032ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
8602026-03-03T18:57:02.032ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8612026-03-03T18:57:02.032ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
8622026-03-03T18:57:02.032ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8632026-03-03T18:57:02.033ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8642026-03-03T18:57:02.035ZTRACtest_metrics (dns): buffer buffer = Length: 75 (0x4b) bytes\n0000: f4 13 01 00 00 01 00 00 00 00 00 01 0c 5f 6e 61 ............._na\n0010: 6d 65 73 65 72 76 69 63 65 04 5f 74 63 70 0d 63 meservice._tcp.c\n0020: 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 ontrol-plane.oxi\n0030: 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 de.internal..!..\n0040: 00 00 29 04 d0 00 00 00 00 00 00 ..)........ kind = dns peer_addr = [::1]:17372 req_id = 38ef3b36-ae57-4c01-ae0c-bf62bf23e558
8652026-03-03T18:57:02.035ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 62483,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_nameservice._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_nameservice._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 12,\n 95,\n 110,\n 97,\n 109,\n 101,\n 115,\n 101,\n 114,\n 118,\n 105,\n 99,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:17372 req_id = 38ef3b36-ae57-4c01-ae0c-bf62bf23e558
8662026-03-03T18:57:02.035ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62483, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nameservice._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 12, 95, 110, 97, 109, 101, 115, 101, 114, 118, 105, 99, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nameservice._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:17372 req_id = 38ef3b36-ae57-4c01-ae0c-bf62bf23e558
8672026-03-03T18:57:02.035ZTRACtest_metrics (dns): buffer buffer = Length: 76 (0x4c) bytes\n0000: 47 9c 01 00 00 01 00 00 00 00 00 01 0d 5f 65 78 G............_ex\n0010: 74 65 72 6e 61 6c 2d 64 6e 73 04 5f 74 63 70 0d ternal-dns._tcp.\n0020: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0030: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 ide.internal..!.\n0040: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:18350 req_id = 390b6945-bd96-4740-ba08-474f4b438fe3
8682026-03-03T18:57:02.035ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 18332,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_external-dns._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_external-dns._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 13,\n 95,\n 101,\n 120,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 45,\n 100,\n 110,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:18350 req_id = 390b6945-bd96-4740-ba08-474f4b438fe3
8692026-03-03T18:57:02.035ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18332, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_external-dns._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 13, 95, 101, 120, 116, 101, 114, 110, 97, 108, 45, 100, 110, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_external-dns._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:18350 req_id = 390b6945-bd96-4740-ba08-474f4b438fe3
8702026-03-03T18:57:02.035ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 43 b8 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 C............_de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:45572 req_id = e63d5c89-c94b-4bee-8138-c8d7f640c513
8712026-03-03T18:57:02.035ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 17336,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:45572 req_id = e63d5c89-c94b-4bee-8138-c8d7f640c513
8722026-03-03T18:57:02.035ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 17336, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:45572 req_id = e63d5c89-c94b-4bee-8138-c8d7f640c513
8732026-03-03T18:57:02.036ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 6e 56 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 nV..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:34318 req_id = a25e7271-605f-429a-a491-8195cd094995
8742026-03-03T18:57:02.036ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 28246,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:34318 req_id = a25e7271-605f-429a-a491-8195cd094995
8752026-03-03T18:57:02.036ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28246, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_mgs._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 4, 95, 109, 103, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_mgs._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:34318 req_id = a25e7271-605f-429a-a491-8195cd094995
8762026-03-03T18:57:02.036ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: e6 48 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .H..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:41473 req_id = db6fa608-9102-49a9-9ab7-d5dd0c7abdcf
8772026-03-03T18:57:02.036ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 58952,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:41473 req_id = db6fa608-9102-49a9-9ab7-d5dd0c7abdcf
8782026-03-03T18:57:02.036ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58952, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:41473 req_id = db6fa608-9102-49a9-9ab7-d5dd0c7abdcf
8792026-03-03T18:57:02.036ZERROtest_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = multicast_reconciler error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8802026-03-03T18:57:02.036ZERROtest_metrics (BackgroundTasks): failed to build DPD clients background_task = multicast_reconciler error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8812026-03-03T18:57:02.036ZERROtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed with dataplane inconsistencies active_groups_verified = 0 background_task = multicast_reconciler dataplane_error_count = 1 external_groups_created = 0 external_groups_deleted = 0 member_state_transitions = 0 orphaned_members_cleaned = 0
8822026-03-03T18:57:02.037ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 8.720473ms iteration = 1 status = {"disabled":false,"empty_groups_marked":0,"errors":["failed to create multicast dataplane client: Internal Error: failed to build DPD clients"],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
8832026-03-03T18:57:02.037ZERROtest_metrics (BackgroundTasks): failed to resolve MGS addresses background_task = sp_ereport_ingester error = Resolve(ResolveError { kind: Proto(ProtoError { kind: NoRecordsFound { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, soa: None, ns: None, negative_ttl: None, response_code: ServFail, trusted: true, authorities: None } }) })
8842026-03-03T18:57:02.037ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 8.622624ms iteration = 1 status = {"disabled":false,"errors":["failed to resolve MGS addresses: proto error: no records found for Query { name: Name(\\"_mgs._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"],"sps":[]}
8852026-03-03T18:57:02.037ZERROtest_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = attached_subnet_manager error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8862026-03-03T18:57:02.037ZERROtest_metrics (BackgroundTasks): failed to lookup Dendrite clients, will not be able to forward attachments to Dendrite background_task = attached_subnet_manager error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8872026-03-03T18:57:02.037ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database
8882026-03-03T18:57:02.037ZDEBGtest_metrics (BackgroundTasks): roles background_task = attached_subnet_manager roles = RoleSet { roles: {} }
8892026-03-03T18:57:02.037ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database result = Ok(())
8902026-03-03T18:57:02.038ZWARNtest_metrics (BackgroundTasks): failed to lookup DNS servers background_task = dns_servers_internal dns_group = internal error = proto error: no records found for Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8912026-03-03T18:57:02.038ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 29.126804ms iteration = 1 status = {"error":"failed to read list of DNS servers: proto error: no records found for Query { name: Name(\\"_nameservice._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
8922026-03-03T18:57:02.038ZWARNtest_metrics (BackgroundTasks): failed to lookup DNS servers background_task = dns_servers_external dns_group = external error = proto error: no records found for Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8932026-03-03T18:57:02.038ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 27.978263ms iteration = 1 status = {"error":"failed to read list of DNS servers: proto error: no records found for Query { name: Name(\\"_external-dns._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
8942026-03-03T18:57:02.043ZTRACtest_metrics (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
8952026-03-03T18:57:02.043ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 35 06 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 5............_de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:3353 req_id = fe6ddd2a-3505-43a0-90c4-7ce14abe4d52
8962026-03-03T18:57:02.043ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 13574,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:3353 req_id = fe6ddd2a-3505-43a0-90c4-7ce14abe4d52
8972026-03-03T18:57:02.043ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13574, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:3353 req_id = fe6ddd2a-3505-43a0-90c4-7ce14abe4d52
8982026-03-03T18:57:02.044ZERROtest_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = bfd_manager error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8992026-03-03T18:57:02.044ZERROtest_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = bfd_manager error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
9002026-03-03T18:57:02.044ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 30.987718ms iteration = 1 status = {"error":"failed to resolve addresses for Dendrite services: proto error: no records found for Query { name: Name(\\"_dendrite._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
9012026-03-03T18:57:02.073ZINFOtest_metrics (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2026-03-03 18:47:02.010725198 UTC pruned = {}
9022026-03-03T18:57:02.073ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 59.284741ms iteration = 1 status = {"expiration":"2026-03-03T18:47:02.010725198Z","pruned":[]}
9032026-03-03T18:57:02.073ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 56.711738ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9042026-03-03T18:57:02.086ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
9052026-03-03T18:57:02.087ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: f0 d6 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:15807 req_id = 90475392-8a43-4eb4-b181-f136f098bec5
9062026-03-03T18:57:02.087ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 61654,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:15807 req_id = 90475392-8a43-4eb4-b181-f136f098bec5
9072026-03-03T18:57:02.087ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61654, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:15807 req_id = 90475392-8a43-4eb4-b181-f136f098bec5
9082026-03-03T18:57:02.088ZERROtest_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = nat_garbage_collector error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
9092026-03-03T18:57:02.088ZERROtest_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = nat_garbage_collector error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
9102026-03-03T18:57:02.088ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 75.578816ms iteration = 1 status = {"error":"failed to resolve addresses for Dendrite services: proto error: no records found for Query { name: Name(\\"_dendrite._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
9112026-03-03T18:57:02.105ZDEBGtest_metrics (init_with_steps): Running step start_dendrite_switch0
9122026-03-03T18:57:02.105ZDEBGtest_metrics: Starting Dendrite for switch0
9132026-03-03T18:57:02.142ZDEBGtest_metrics (init_with_steps): Running step start_mgd_switch0
9142026-03-03T18:57:02.142ZDEBGtest_metrics: Starting mgd for switch0
9152026-03-03T18:57:02.222ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9162026-03-03T18:57:02.225ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
9172026-03-03T18:57:02.226ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
9182026-03-03T18:57:02.226ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9192026-03-03T18:57:02.226ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
9202026-03-03T18:57:02.227ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:41339 remote_addr = 127.0.0.1:36710
9212026-03-03T18:57:02.228ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36710 req_id = 7ca489f1-861b-4199-b6cc-da54bfdcab7f uri = /nat/ipv4/changeset/0?limit=100
9222026-03-03T18:57:02.228ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36710 req_id = 7ca489f1-861b-4199-b6cc-da54bfdcab7f uri = /nat/ipv4/changeset/0?limit=100 version = 1.0.0
9232026-03-03T18:57:02.229ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36710 req_id = 7ca489f1-861b-4199-b6cc-da54bfdcab7f resource = Database type = user_builtin uri = /nat/ipv4/changeset/0?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
9242026-03-03T18:57:02.231ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36710 req_id = 7ca489f1-861b-4199-b6cc-da54bfdcab7f roles = RoleSet { roles: {} } type = user_builtin uri = /nat/ipv4/changeset/0?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
9252026-03-03T18:57:02.231ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36710 req_id = 7ca489f1-861b-4199-b6cc-da54bfdcab7f resource = Database result = Ok(()) type = user_builtin uri = /nat/ipv4/changeset/0?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
9262026-03-03T18:57:02.243ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9272026-03-03T18:57:02.247ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
9282026-03-03T18:57:02.260ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
9292026-03-03T18:57:02.260ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
9302026-03-03T18:57:02.261ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
9312026-03-03T18:57:02.271ZDEBGtest_metrics (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9322026-03-03T18:57:02.278ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9332026-03-03T18:57:02.281ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database
9342026-03-03T18:57:02.281ZDEBGtest_metrics (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9352026-03-03T18:57:02.281ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
9362026-03-03T18:57:02.291ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9372026-03-03T18:57:02.295ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9382026-03-03T18:57:02.295ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
9392026-03-03T18:57:02.295ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9402026-03-03T18:57:02.295ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
9412026-03-03T18:57:02.296ZDEBGtest_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9422026-03-03T18:57:02.320ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
9432026-03-03T18:57:02.320ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database
9442026-03-03T18:57:02.320ZDEBGtest_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
9452026-03-03T18:57:02.320ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
9462026-03-03T18:57:02.329ZDEBGtest_metrics (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9472026-03-03T18:57:02.333ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9482026-03-03T18:57:02.333ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database
9492026-03-03T18:57:02.333ZDEBGtest_metrics (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9502026-03-03T18:57:02.333ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9512026-03-03T18:57:02.345ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
9522026-03-03T18:57:02.345ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9532026-03-03T18:57:02.360ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9542026-03-03T18:57:02.361ZDEBGtest_metrics: mgd port is 36843
9552026-03-03T18:57:02.361ZDEBGtest_metrics (init_with_steps): Running step record_switch_dns
9562026-03-03T18:57:02.361ZDEBGtest_metrics: Recording DNS for the switch zones sled_id = b6d65341-167c-41df-9b5c-41cded99c229 switch_location = switch0
9572026-03-03T18:57:02.361ZDEBGtest_metrics (init_with_steps): Running step start_sled1
9582026-03-03T18:57:02.361ZINFOtest_metrics (omicron_sled_agent::sim::Server): setting up sled agent server sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9592026-03-03T18:57:02.374ZINFOtest_metrics (SledAgent): created simulated sled agent server = b6d65341-167c-41df-9b5c-41cded99c229 sim_mode = Explicit sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9602026-03-03T18:57:02.374ZINFOtest_metrics (omicron_sled_agent::sim::SimulatedUpstairs): registered sled b6d65341-167c-41df-9b5c-41cded99c229 storage
9612026-03-03T18:57:02.379ZINFOtest_metrics (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpGaEqDK/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9622026-03-03T18:57:02.379ZDEBGtest_metrics (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpGaEqDK/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9632026-03-03T18:57:02.379ZINFOtest_metrics (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpcnvX1z/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9642026-03-03T18:57:02.379ZDEBGtest_metrics (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpcnvX1z/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9652026-03-03T18:57:02.388ZDEBGtest_metrics (dropshot (Repo Depot)): registered endpoint local_addr = [::1]:42957 method = GET path = /artifact/sha256/{sha256} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9662026-03-03T18:57:02.388ZINFOtest_metrics (dropshot (Repo Depot)): listening local_addr = [::1]:42957 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9672026-03-03T18:57:02.388ZDEBGtest_metrics (dropshot (Repo Depot)): successfully registered DTrace USDT probes local_addr = [::1]:42957 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9682026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /artifacts sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9692026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /artifacts/{sha256} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9702026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /artifacts/{sha256}/copy-from-depot sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9712026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /artifacts-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9722026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /artifacts-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9732026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /bootstore/status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9742026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /chicken-switch/destroy-orphaned-datasets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 2.0.0
9752026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /chicken-switch/destroy-orphaned-datasets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 3.0.0
9762026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /debug/switch-zone-policy sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 3.0.0
9772026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /debug/switch-zone-policy sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 3.0.0
9782026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /disks/{disk_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 21.0.0
9792026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /eip-gateways sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9802026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 22.0.0
9812026-03-03T18:57:02.391ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 16.0.0 to 22.0.0
9822026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 14.0.0 to 16.0.0
9832026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 12.0.0 to 14.0.0
9842026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 11.0.0 to 12.0.0
9852026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 10.0.0 to 11.0.0
9862026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 4.0.0 to 10.0.0
9872026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 4.0.0
9882026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = DELETE path = /local-storage sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 17.0.0
9892026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /local-storage sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 17.0.0
9902026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = DELETE path = /local-storage/{zpool_id}/{dataset_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 9.0.0 to 17.0.0
9912026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /local-storage/{zpool_id}/{dataset_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 9.0.0 to 17.0.0
9922026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 20.0.0 to 23.0.0
9932026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 20.0.0
9942026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 20.0.0
9952026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 20.0.0
9962026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 14.0.0
9972026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 11.0.0 to 14.0.0
9982026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 10.0.0 to 11.0.0
9992026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 4.0.0 to 10.0.0
10002026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 4.0.0
10012026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /probes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 10.0.0
10022026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /probes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 6.0.0 to 10.0.0
10032026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /rot/{rot}/attest sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 19.0.0
10042026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /rot/{rot}/certificate-chain sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 19.0.0
10052026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /rot/{rot}/measurement-log sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 19.0.0
10062026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /sled-identifiers sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10072026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /sled-role sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 8.0.0
10082026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /sleds sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10092026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support/dladm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10102026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support/health-check sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10112026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support/ipadm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10122026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support/logs/download/{zone} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10132026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support/logs/zones sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10142026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support/nvmeadm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10152026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support/pargs-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10162026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support/pfiles-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10172026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support/pstack-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10182026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support/zfs-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10192026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support/zoneadm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10202026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support/zpool-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10212026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support-bundles/{zpool_id}/{dataset_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10222026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = DELETE path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10232026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10242026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10252026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = HEAD path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10262026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download/{file} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10272026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = HEAD path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download/{file} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10282026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/finalize sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10292026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/index sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10302026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = HEAD path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/index sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10312026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/transfer sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10322026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /switch-ports sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 20.0.0
10332026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /switch-ports sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 20.0.0
10342026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /trust-quorum/commit sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10352026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /trust-quorum/configuration sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10362026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /trust-quorum/coordinator-status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10372026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /trust-quorum/network-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 15.0.0
10382026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /trust-quorum/network-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 15.0.0
10392026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /trust-quorum/prepare-and-commit sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10402026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /trust-quorum/proxy/commit sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10412026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /trust-quorum/proxy/prepare-and-commit sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10422026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /trust-quorum/proxy/status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10432026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /trust-quorum/status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 15.0.0
10442026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /trust-quorum/upgrade sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10452026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = DELETE path = /v2p sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10462026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /v2p sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10472026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /v2p sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10482026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = DELETE path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10492026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10502026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 17.0.0 to 18.0.0
10512026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 11.0.0 to 17.0.0
10522026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 10.0.0 to 11.0.0
10532026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 9.0.0 to 10.0.0
10542026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 7.0.0 to 9.0.0
10552026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 7.0.0
10562026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = DELETE path = /vmms/{propolis_id}/attached-subnets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10572026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /vmms/{propolis_id}/attached-subnets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10582026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vmms/{propolis_id}/attached-subnets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10592026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = DELETE path = /vmms/{propolis_id}/attached-subnets/{subnet} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10602026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /vmms/{propolis_id}/disks/{disk_id}/snapshot sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10612026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = DELETE path = /vmms/{propolis_id}/external-ip sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10622026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vmms/{propolis_id}/external-ip sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10632026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = DELETE path = /vmms/{propolis_id}/multicast-group sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 7.0.0
10642026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vmms/{propolis_id}/multicast-group sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 7.0.0
10652026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /vmms/{propolis_id}/poke sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10662026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /vmms/{propolis_id}/poke-single-step sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10672026-03-03T18:57:02.392ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /vmms/{propolis_id}/sim-migration-source sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10682026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /vmms/{propolis_id}/state sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10692026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vmms/{propolis_id}/state sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10702026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vpc/{vpc_id}/firewall/rules sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 10.0.0
10712026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vpc/{vpc_id}/firewall/rules sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 10.0.0
10722026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /vpc-routes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10732026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /vpc-routes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10742026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /zones sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10752026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = POST path = /zones/bundle-cleanup sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10762026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /zones/bundle-cleanup/context sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10772026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = PUT path = /zones/bundle-cleanup/context sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10782026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /zones/bundle-cleanup/utilization sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10792026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /zones/bundles sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10802026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /zones/bundles/{zone_name} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10812026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = DELETE path = /zones/bundles/{zone_name}/{bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10822026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:36085 method = GET path = /zones/bundles/{zone_name}/{bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10832026-03-03T18:57:02.393ZINFOtest_metrics (dropshot): listening local_addr = [::1]:36085 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10842026-03-03T18:57:02.393ZDEBGtest_metrics (dropshot): successfully registered DTrace USDT probes local_addr = [::1]:36085 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10852026-03-03T18:57:02.393ZDEBGtest_metrics (omicron_sled_agent::sim::Server): contacting server nexus sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10862026-03-03T18:57:02.393ZDEBGtest_metrics (NexusClient): client request body = Some(Body) method = POST sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = http://127.0.0.1:41339/sled-agents/b6d65341-167c-41df-9b5c-41cded99c229
10872026-03-03T18:57:02.393ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:41339 remote_addr = 127.0.0.1:36712
10882026-03-03T18:57:02.393ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10892026-03-03T18:57:02.397ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10902026-03-03T18:57:02.397ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
10912026-03-03T18:57:02.397ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10922026-03-03T18:57:02.398ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
10932026-03-03T18:57:02.399ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36712 req_id = 15e0a6d6-5e41-492a-9cc7-a5c9589e0868 uri = /sled-agents/b6d65341-167c-41df-9b5c-41cded99c229
10942026-03-03T18:57:02.399ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36712 req_id = 15e0a6d6-5e41-492a-9cc7-a5c9589e0868 uri = /sled-agents/b6d65341-167c-41df-9b5c-41cded99c229 version = 1.0.0
10952026-03-03T18:57:02.399ZINFOtest_metrics (nexus): registered sled agent sled_uuid = b6d65341-167c-41df-9b5c-41cded99c229
10962026-03-03T18:57:02.425ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 401.130966ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
10972026-03-03T18:57:02.425ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database
10982026-03-03T18:57:02.425ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10992026-03-03T18:57:02.425ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
11002026-03-03T18:57:02.457ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11012026-03-03T18:57:02.461ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
11022026-03-03T18:57:02.461ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
11032026-03-03T18:57:02.461ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
11042026-03-03T18:57:02.461ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
11052026-03-03T18:57:02.518ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 492.038165ms iteration = 1 status = {"errors":[],"requests_created_ok":[]}
11062026-03-03T18:57:02.520ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11072026-03-03T18:57:02.523ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
11082026-03-03T18:57:02.523ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
11092026-03-03T18:57:02.523ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11102026-03-03T18:57:02.523ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
11112026-03-03T18:57:02.523ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
11122026-03-03T18:57:02.523ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
11132026-03-03T18:57:02.524ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database
11142026-03-03T18:57:02.524ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11152026-03-03T18:57:02.524ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11162026-03-03T18:57:02.535ZINFOtest_metrics (SagaRecoverer): listed in-progress sagas count = 0
11172026-03-03T18:57:02.535ZINFOtest_metrics (SagaQuiesceHandle): saga recovery pass finished blueprint_id = None generation = 1
11182026-03-03T18:57:02.535ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 512.443247ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
11192026-03-03T18:57:02.535ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Fleet
11202026-03-03T18:57:02.536ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = fm_sitrep_gc resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11212026-03-03T18:57:02.536ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database
11222026-03-03T18:57:02.536ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
11232026-03-03T18:57:02.536ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
11242026-03-03T18:57:02.549ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database
11252026-03-03T18:57:02.549ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11262026-03-03T18:57:02.549ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11272026-03-03T18:57:02.549ZDEBGtest_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11282026-03-03T18:57:02.551ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
11292026-03-03T18:57:02.551ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet
11302026-03-03T18:57:02.551ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = probe_distributor resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11312026-03-03T18:57:02.551ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database
11322026-03-03T18:57:02.551ZDEBGtest_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
11332026-03-03T18:57:02.551ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
11342026-03-03T18:57:02.557ZDEBGtest_metrics (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11352026-03-03T18:57:02.560ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet result = Ok(())
11362026-03-03T18:57:02.560ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database
11372026-03-03T18:57:02.560ZDEBGtest_metrics (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
11382026-03-03T18:57:02.560ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
11392026-03-03T18:57:02.561ZINFOtest_metrics (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator num_receivers = 0
11402026-03-03T18:57:02.561ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 533.379879ms iteration = 1 status = {"by_rx":{},"error":null}
11412026-03-03T18:57:02.575ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database
11422026-03-03T18:57:02.575ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11432026-03-03T18:57:02.576ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11442026-03-03T18:57:02.582ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11452026-03-03T18:57:02.585ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11462026-03-03T18:57:02.585ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
11472026-03-03T18:57:02.585ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11482026-03-03T18:57:02.585ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
11492026-03-03T18:57:02.585ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11502026-03-03T18:57:02.586ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11512026-03-03T18:57:02.587ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 562.108983ms iteration = 1 status = {"errors":[],"finish_invoked_ok":[]}
11522026-03-03T18:57:02.589ZDEBGtest_metrics (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11532026-03-03T18:57:02.589ZINFOtest_metrics (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11542026-03-03T18:57:02.589ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 566.85277ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11552026-03-03T18:57:02.590ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig
11562026-03-03T18:57:02.590ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11572026-03-03T18:57:02.590ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
11582026-03-03T18:57:02.590ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11592026-03-03T18:57:02.590ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
11602026-03-03T18:57:02.594ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11612026-03-03T18:57:02.607ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11622026-03-03T18:57:02.607ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11632026-03-03T18:57:02.615ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11642026-03-03T18:57:02.615ZTRACtest_metrics (BackgroundTasks): no more instances in need of reincarnation background_task = instance_reincarnation reincarnation_reason = instance failed total_found = 0
11652026-03-03T18:57:02.615ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database
11662026-03-03T18:57:02.615ZDEBGtest_metrics (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11672026-03-03T18:57:02.620ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11682026-03-03T18:57:02.622ZDEBGtest_metrics (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: false, planner_config: PlannerConfig { add_zones_with_mupdate_override: false }, tuf_repo_pruner_enabled: true }, time_modified: 2026-03-03T18:57:01.943241Z })
11692026-03-03T18:57:02.622ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 607.274672ms iteration = 1 status = {"config_updated":true}
11702026-03-03T18:57:02.622ZDEBGtest_metrics (BackgroundTasks): activating background_task = tuf_repo_pruner iteration = 2 reason = Dependency
11712026-03-03T18:57:02.622ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet
11722026-03-03T18:57:02.622ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_repo_pruner resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11732026-03-03T18:57:02.622ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
11742026-03-03T18:57:02.622ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
11752026-03-03T18:57:02.623ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
11762026-03-03T18:57:02.623ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 2 reason = Dependency
11772026-03-03T18:57:02.623ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
11782026-03-03T18:57:02.623ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 35.52\u{b5}s iteration = 2 status = "Disabled"
11792026-03-03T18:57:02.624ZINFOtest_metrics (dropshot_internal): request completed latency_us = 395873 local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36710 req_id = 7ca489f1-861b-4199-b6cc-da54bfdcab7f response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
11802026-03-03T18:57:02.624ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 606.211081ms iteration = 1 status = {}
11812026-03-03T18:57:02.638ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
11822026-03-03T18:57:02.638ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11832026-03-03T18:57:02.638ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11842026-03-03T18:57:02.655ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
11852026-03-03T18:57:02.661ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
11862026-03-03T18:57:02.661ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: e2 ed 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:20376 req_id = 7b41357a-8aa3-472b-9f87-0ec492411428
11872026-03-03T18:57:02.661ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 58093,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:20376 req_id = 7b41357a-8aa3-472b-9f87-0ec492411428
11882026-03-03T18:57:02.661ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58093, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_mgs._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 4, 95, 109, 103, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_mgs._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:20376 req_id = 7b41357a-8aa3-472b-9f87-0ec492411428
11892026-03-03T18:57:02.661ZWARNtest_metrics (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: looking up MGS addresses: proto error: no records found for Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
11902026-03-03T18:57:02.661ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 643.017567ms iteration = 1 status = {"error":"failed to collect inventory: looking up MGS addresses: proto error: no records found for Query { name: Name(\\"_mgs._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
11912026-03-03T18:57:02.708ZWARNtest_metrics (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set
11922026-03-03T18:57:02.708ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 690.908561ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
11932026-03-03T18:57:02.741ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 727.086026ms iteration = 1 status = "NoCollections"
11942026-03-03T18:57:02.746ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11952026-03-03T18:57:02.764ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
11962026-03-03T18:57:02.764ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
11972026-03-03T18:57:02.764ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
11982026-03-03T18:57:02.764ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
11992026-03-03T18:57:02.789ZWARNtest_metrics (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0
12002026-03-03T18:57:02.789ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 782.988582ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
12012026-03-03T18:57:02.790ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 765.281015ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
12022026-03-03T18:57:02.817ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12032026-03-03T18:57:02.825ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
12042026-03-03T18:57:02.826ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database
12052026-03-03T18:57:02.826ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
12062026-03-03T18:57:02.827ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
12072026-03-03T18:57:02.828ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
12082026-03-03T18:57:02.835ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12092026-03-03T18:57:02.835ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
12102026-03-03T18:57:02.843ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12112026-03-03T18:57:02.864ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Fleet result = Ok(())
12122026-03-03T18:57:02.865ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = region_replacement elapsed = 845.285067ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12132026-03-03T18:57:02.865ZWARNtest_metrics (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0
12142026-03-03T18:57:02.865ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 855.493823ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
12152026-03-03T18:57:02.865ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet
12162026-03-03T18:57:02.865ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = support_bundle_collector resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12172026-03-03T18:57:02.865ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database
12182026-03-03T18:57:02.865ZDEBGtest_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12192026-03-03T18:57:02.866ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12202026-03-03T18:57:02.883ZDEBGtest_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12212026-03-03T18:57:02.886ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
12222026-03-03T18:57:02.886ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database
12232026-03-03T18:57:02.887ZDEBGtest_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
12242026-03-03T18:57:02.887ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
12252026-03-03T18:57:02.902ZTRACtest_metrics (BackgroundTasks): reprocessing 0 outdated webhook globs... background_task = alert_dispatcher
12262026-03-03T18:57:02.902ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database
12272026-03-03T18:57:02.902ZDEBGtest_metrics (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
12282026-03-03T18:57:02.904ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
12292026-03-03T18:57:02.904ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database
12302026-03-03T18:57:02.904ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12312026-03-03T18:57:02.904ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12322026-03-03T18:57:02.907ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database
12332026-03-03T18:57:02.907ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
12342026-03-03T18:57:02.908ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
12352026-03-03T18:57:02.908ZINFOtest_metrics (BackgroundTasks): all instance checks complete background_task = instance_watcher pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12362026-03-03T18:57:02.908ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 888.037683ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12372026-03-03T18:57:02.910ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12382026-03-03T18:57:02.915ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
12392026-03-03T18:57:02.915ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
12402026-03-03T18:57:02.915ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12412026-03-03T18:57:02.916ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
12422026-03-03T18:57:02.941ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12432026-03-03T18:57:02.944ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet result = Ok(())
12442026-03-03T18:57:02.944ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
12452026-03-03T18:57:02.944ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
12462026-03-03T18:57:02.945ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
12472026-03-03T18:57:02.959ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
12482026-03-03T18:57:02.959ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
12492026-03-03T18:57:02.959ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
12502026-03-03T18:57:02.959ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12512026-03-03T18:57:02.959ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12522026-03-03T18:57:02.981ZDEBGtest_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12532026-03-03T18:57:02.988ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
12542026-03-03T18:57:02.990ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database
12552026-03-03T18:57:02.990ZDEBGtest_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12562026-03-03T18:57:02.991ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12572026-03-03T18:57:02.998ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 969.526769ms iteration = 1 status = "NoSitrep"
12582026-03-03T18:57:02.999ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 978.999123ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12592026-03-03T18:57:03.000ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Fleet
12602026-03-03T18:57:03.000ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = fm_sitrep_gc resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12612026-03-03T18:57:03.000ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database
12622026-03-03T18:57:03.000ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
12632026-03-03T18:57:03.000ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
12642026-03-03T18:57:03.006ZTRACtest_metrics (BackgroundTasks): webhook dispatching completed successfully background_task = alert_dispatcher events_dispatched = 0 events_without_receivers = 0
12652026-03-03T18:57:03.006ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 979.226664ms iteration = 1 status = {"dispatched":[],"errors":[],"glob_version":"233.0.0","globs_reprocessed":{},"no_receivers":[]}
12662026-03-03T18:57:03.006ZINFOtest_metrics (BackgroundTasks): Loaded 0 active trust quorum configurations from database background_task = trust_quorum_manager bgtask = TrustQuorumManager
12672026-03-03T18:57:03.007ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = trust_quorum_manager elapsed = 976.63762ms iteration = 1 status = {"PerRackStatus":{"errors":[],"statuses":[]}}
12682026-03-03T18:57:03.029ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12692026-03-03T18:57:03.029ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Fleet result = Ok(())
12702026-03-03T18:57:03.035ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
12712026-03-03T18:57:03.035ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
12722026-03-03T18:57:03.035ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12732026-03-03T18:57:03.035ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12742026-03-03T18:57:03.086ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet
12752026-03-03T18:57:03.086ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_repo_pruner resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12762026-03-03T18:57:03.086ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
12772026-03-03T18:57:03.086ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
12782026-03-03T18:57:03.087ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
12792026-03-03T18:57:03.125ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12802026-03-03T18:57:03.128ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet result = Ok(())
12812026-03-03T18:57:03.136ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
12822026-03-03T18:57:03.138ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
12832026-03-03T18:57:03.138ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
12842026-03-03T18:57:03.140ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 1.11397695s iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12852026-03-03T18:57:03.174ZINFOtest_metrics (BackgroundTasks): deleted 0 of 0 sitreps sitreps background_task = fm_sitrep_gc case_ereports_deleted = 0 cases_deleted = 0 ids = [] sitreps_deleted = 0
12862026-03-03T18:57:03.174ZTRACtest_metrics (BackgroundTasks): all 0 orphaned sitreps in this batch have already been deleted background_task = fm_sitrep_gc
12872026-03-03T18:57:03.174ZINFOtest_metrics (BackgroundTasks): sitrep garbage collection found 0 orphaned sitreps, deleted 0 background_task = fm_sitrep_gc
12882026-03-03T18:57:03.174ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = fm_sitrep_gc elapsed = 1.144930428s iteration = 1 status = {"errors":[],"orphaned_sitreps_deleted":0,"orphaned_sitreps_found":0}
12892026-03-03T18:57:03.183ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12902026-03-03T18:57:03.184ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12912026-03-03T18:57:03.184ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
12922026-03-03T18:57:03.184ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12932026-03-03T18:57:03.184ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12942026-03-03T18:57:03.184ZDEBGtest_metrics (BackgroundTasks): listed attached subnets background_task = attached_subnet_manager n_subnets = 0
12952026-03-03T18:57:03.184ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = attached_subnet_manager elapsed = 1.153468441s iteration = 1 status = {"db_error":null,"dendrite":{},"sled":{}}
12962026-03-03T18:57:03.191ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 1.16573211s iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
12972026-03-03T18:57:03.208ZINFOtest_metrics (BackgroundTasks): No bundles to collect background_task = support_bundle_collector
12982026-03-03T18:57:03.208ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 1.190916128s iteration = 1 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
12992026-03-03T18:57:03.209ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13002026-03-03T18:57:03.209ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
13012026-03-03T18:57:03.209ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13022026-03-03T18:57:03.211ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13032026-03-03T18:57:03.237ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = TargetReleaseConfig
13042026-03-03T18:57:03.237ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_repo_pruner resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13052026-03-03T18:57:03.237ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
13062026-03-03T18:57:03.237ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
13072026-03-03T18:57:03.238ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
13082026-03-03T18:57:03.239ZWARNtest_metrics (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone
13092026-03-03T18:57:03.239ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 1.228089836s iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
13102026-03-03T18:57:03.239ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13112026-03-03T18:57:03.247ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13122026-03-03T18:57:03.249ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "Vpc" using built-in user background_task = service_firewall_rule_propagation
13132026-03-03T18:57:03.249ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
13142026-03-03T18:57:03.249ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
13152026-03-03T18:57:03.249ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
13162026-03-03T18:57:03.249ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13172026-03-03T18:57:03.250ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13182026-03-03T18:57:03.262ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
13192026-03-03T18:57:03.262ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
13202026-03-03T18:57:03.262ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13212026-03-03T18:57:03.263ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13222026-03-03T18:57:03.264ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13232026-03-03T18:57:03.268ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = TargetReleaseConfig result = Ok(())
13242026-03-03T18:57:03.269ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
13252026-03-03T18:57:03.269ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
13262026-03-03T18:57:03.269ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
13272026-03-03T18:57:03.294ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13282026-03-03T18:57:03.296ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
13292026-03-03T18:57:03.296ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13302026-03-03T18:57:03.296ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13312026-03-03T18:57:03.300ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13322026-03-03T18:57:03.308ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13332026-03-03T18:57:03.308ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
13342026-03-03T18:57:03.308ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13352026-03-03T18:57:03.310ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13362026-03-03T18:57:03.310ZINFOtest_metrics (BackgroundTasks): tuf_repo_prune decision background_task = tuf_repo_pruner status = TufRepoPrunerDetails { nkeep_recent_releases: 3, nkeep_recent_uploads: 2, repos_keep_target_release: {}, repos_keep_recent_uploads: {}, repo_prune: None, other_repos_eligible_to_prune: {}, warnings: [] }
13372026-03-03T18:57:03.310ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = tuf_repo_pruner elapsed = 688.543367ms iteration = 2 status = {"nkeep_recent_releases":3,"nkeep_recent_uploads":2,"other_repos_eligible_to_prune":[],"repo_prune":null,"repos_keep_recent_uploads":[],"repos_keep_target_release":[],"status":"enabled","warnings":[]}
13382026-03-03T18:57:03.329ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
13392026-03-03T18:57:03.329ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
13402026-03-03T18:57:03.329ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13412026-03-03T18:57:03.329ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
13422026-03-03T18:57:03.329ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13432026-03-03T18:57:03.329ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
13442026-03-03T18:57:03.329ZINFOtest_metrics (dropshot_internal): request completed latency_us = 929229 local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36712 req_id = 15e0a6d6-5e41-492a-9cc7-a5c9589e0868 response_code = 204 uri = /sled-agents/b6d65341-167c-41df-9b5c-41cded99c229
13452026-03-03T18:57:03.329ZDEBGtest_metrics (NexusClient): client response result = Ok(Response { url: "http://127.0.0.1:41339/sled-agents/b6d65341-167c-41df-9b5c-41cded99c229", status: 204, headers: {"x-request-id": "15e0a6d6-5e41-492a-9cc7-a5c9589e0868", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} }) sled_id = b6d65341-167c-41df-9b5c-41cded99c229
13462026-03-03T18:57:03.329ZDEBGtest_metrics (init_with_steps): Running step configure_boundary_ntp
13472026-03-03T18:57:03.329ZDEBGtest_metrics (init_with_steps): Running step start_crucible_pantry
13482026-03-03T18:57:03.329ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:32837 method = GET path = /crucible/pantry/0 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13492026-03-03T18:57:03.329ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:32837 method = GET path = /crucible/pantry/0/job/{id}/is-finished sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13502026-03-03T18:57:03.329ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:32837 method = GET path = /crucible/pantry/0/job/{id}/ok sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13512026-03-03T18:57:03.329ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:32837 method = DELETE path = /crucible/pantry/0/volume/{id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13522026-03-03T18:57:03.329ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:32837 method = GET path = /crucible/pantry/0/volume/{id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13532026-03-03T18:57:03.329ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:32837 method = POST path = /crucible/pantry/0/volume/{id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13542026-03-03T18:57:03.329ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:32837 method = POST path = /crucible/pantry/0/volume/{id}/background sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13552026-03-03T18:57:03.329ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:32837 method = POST path = /crucible/pantry/0/volume/{id}/bulk-write sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13562026-03-03T18:57:03.329ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:32837 method = POST path = /crucible/pantry/0/volume/{id}/import-from-url sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13572026-03-03T18:57:03.329ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:32837 method = POST path = /crucible/pantry/0/volume/{id}/scrub sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13582026-03-03T18:57:03.329ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:32837 method = POST path = /crucible/pantry/0/volume/{id}/snapshot sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13592026-03-03T18:57:03.329ZINFOtest_metrics (dropshot): listening kind = pantry local_addr = [::1]:32837 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
13602026-03-03T18:57:03.329ZDEBGtest_metrics (dropshot): successfully registered DTrace USDT probes kind = pantry local_addr = [::1]:32837 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
13612026-03-03T18:57:03.329ZINFOtest_metrics (omicron_sled_agent::sim::Server): Started Simulated Crucible Pantry address = [::1]:32837 kind = pantry sled_id = b6d65341-167c-41df-9b5c-41cded99c229
13622026-03-03T18:57:03.329ZDEBGtest_metrics (init_with_steps): Running step populate_internal_dns
13632026-03-03T18:57:03.329ZDEBGtest_metrics: Populating Internal DNS
13642026-03-03T18:57:03.343ZINFOtest_metrics: DNS population: DnsConfigParams { generation: Generation( 1, ), serial: 1, time_created: 2026-03-03T18:57:03.343663704Z, zones: [ DnsConfigZone { zone_name: "control-plane.oxide.internal", records: { "128cd5ee-2d78-44f6-9fb4-83dda8b3d1a4.host": [ Aaaa( ::1, ), ], "81837bb2-7059-4277-a1d8-85f3ce431be0.host": [ Aaaa( ::1, ), ], "913233fe-92a8-4635-9572-183f495429c4.host": [ Aaaa( ::ffff:127.0.0.1, ), ], "_clickhouse._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 42015, target: "81837bb2-7059-4277-a1d8-85f3ce431be0.host.control-plane.oxide.internal", }, ), ], "8b178ee8-bb89-4436-88d8-e2f462915df4.host": [ Aaaa( ::1, ), ], "_clickhouse-admin-single-server._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 8888, target: "81837bb2-7059-4277-a1d8-85f3ce431be0.host.control-plane.oxide.internal", }, ), ], "_clickhouse-native._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 9000, target: "81837bb2-7059-4277-a1d8-85f3ce431be0.host.control-plane.oxide.internal", }, ), ], "_nameservice._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 34487, target: "2a83ee47-a98f-4924-a414-6bdba496b84f.host.control-plane.oxide.internal", }, ), ], "_mgs._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 42517, target: "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal", }, ), ], "2a83ee47-a98f-4924-a414-6bdba496b84f.host": [ Aaaa( ::1, ), ], "boundary-ntp": [ Aaaa( ::1, ), ], "a0b447ac-c7a0-4310-8017-829376663066.host": [ Aaaa( ::1, ), ], "_repo-depot._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 42957, target: "b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal", }, ), ], "301cc00d-744b-4e0c-83c6-e8f8b1c76505.host": [ Aaaa( ::1, ), ], "_external-dns._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 46173, target: "a0b447ac-c7a0-4310-8017-829376663066.host.control-plane.oxide.internal", }, ), ], "_nexus-lockstep._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 33961, target: "913233fe-92a8-4635-9572-183f495429c4.host.control-plane.oxide.internal", }, ), ], "_dendrite._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 34679, target: "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal", }, ), ], "_crucible-pantry._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 32837, target: "301cc00d-744b-4e0c-83c6-e8f8b1c76505.host.control-plane.oxide.internal", }, ), ], "_boundary-ntp._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 123, target: "128cd5ee-2d78-44f6-9fb4-83dda8b3d1a4.host.control-plane.oxide.internal", }, ), ], "_cockroach._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 43291, target: "8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal", }, ), ], "ns1": [ Aaaa( ::1, ), ], "_oximeter-reader._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 9000, target: "81837bb2-7059-4277-a1d8-85f3ce431be0.host.control-plane.oxide.internal", }, ), ], "_mgd._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 36843, target: "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal", }, ), ], "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host": [ Aaaa( ::1, ), ], "@": [ Ns( "ns1.control-plane.oxide.internal", ), ], "b6d65341-167c-41df-9b5c-41cded99c229.sled": [ Aaaa( ::1, ), ], "_nexus._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 41339, target: "913233fe-92a8-4635-9572-183f495429c4.host.control-plane.oxide.internal", }, ), ], }, }, ], }
13652026-03-03T18:57:03.343ZDEBGtest_metrics: client request body = Some(Body) method = PUT uri = http://[::1]:34487/config
13662026-03-03T18:57:03.344ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
13672026-03-03T18:57:03.344ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13682026-03-03T18:57:03.346ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13692026-03-03T18:57:03.347ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:34487 remote_addr = [::1]:39234
13702026-03-03T18:57:03.347ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:34487 method = PUT remote_addr = [::1]:39234 req_id = 4c053f50-441b-46ef-a67a-5d53f43101dc uri = /config
13712026-03-03T18:57:03.347ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:34487 method = PUT remote_addr = [::1]:39234 req_id = 4c053f50-441b-46ef-a67a-5d53f43101dc uri = /config version = 2.0.0
13722026-03-03T18:57:03.347ZINFOtest_metrics (store): attempting generation update new_generation = 1 req_id = 4c053f50-441b-46ef-a67a-5d53f43101dc
13732026-03-03T18:57:03.347ZINFOtest_metrics (store): pruning trees for generations newer than 0
13742026-03-03T18:57:03.347ZDEBGtest_metrics (store): creating tree tree_name = generation_1_zone_control-plane.oxide.internal
13752026-03-03T18:57:03.349ZDEBGtest_metrics (store): updating current config
13762026-03-03T18:57:03.350ZDEBGtest_metrics (store): flushing default tree
13772026-03-03T18:57:03.371ZINFOtest_metrics (store): pruning trees for generations older than 1 keep = 3
13782026-03-03T18:57:03.371ZINFOtest_metrics (store): updated generation new_generation = 1 req_id = 4c053f50-441b-46ef-a67a-5d53f43101dc
13792026-03-03T18:57:03.372ZINFOtest_metrics (http): request completed kind = dns latency_us = 24686 local_addr = [::1]:34487 method = PUT remote_addr = [::1]:39234 req_id = 4c053f50-441b-46ef-a67a-5d53f43101dc response_code = 204 uri = /config
13802026-03-03T18:57:03.372ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13812026-03-03T18:57:03.381ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
13822026-03-03T18:57:03.381ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
13832026-03-03T18:57:03.381ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13842026-03-03T18:57:03.382ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
13852026-03-03T18:57:03.401ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet
13862026-03-03T18:57:03.401ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = probe_distributor resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13872026-03-03T18:57:03.401ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database
13882026-03-03T18:57:03.401ZDEBGtest_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
13892026-03-03T18:57:03.401ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
13902026-03-03T18:57:03.406ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
13912026-03-03T18:57:03.406ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13922026-03-03T18:57:03.406ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13932026-03-03T18:57:03.416ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
13942026-03-03T18:57:03.416ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13952026-03-03T18:57:03.416ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
13962026-03-03T18:57:03.417ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
13972026-03-03T18:57:03.417ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
13982026-03-03T18:57:03.444ZINFOtest_metrics (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager
13992026-03-03T18:57:03.444ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = None method = GET uri = http://[::1]:36085/vpc-routes
14002026-03-03T18:57:03.450ZDEBGtest_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14012026-03-03T18:57:03.453ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
14022026-03-03T18:57:03.453ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database
14032026-03-03T18:57:03.453ZDEBGtest_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
14042026-03-03T18:57:03.453ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
14052026-03-03T18:57:03.479ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = probe_distributor body = Some(Body) method = PUT uri = http://[::1]:36085/probes
14062026-03-03T18:57:03.479ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
14072026-03-03T18:57:03.479ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
14082026-03-03T18:57:03.480ZTRACtest_metrics (BackgroundTasks): no more instances in need of reincarnation background_task = instance_reincarnation reincarnation_reason = start saga failed total_found = 0
14092026-03-03T18:57:03.480ZINFOtest_metrics (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
14102026-03-03T18:57:03.480ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 1.45890257s iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
14112026-03-03T18:57:03.480ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
14122026-03-03T18:57:03.480ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14132026-03-03T18:57:03.480ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
14142026-03-03T18:57:03.480ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14152026-03-03T18:57:03.481ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
14162026-03-03T18:57:03.482ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35792 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14172026-03-03T18:57:03.482ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35794 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14182026-03-03T18:57:03.482ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14192026-03-03T18:57:03.488ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
14202026-03-03T18:57:03.488ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
14212026-03-03T18:57:03.488ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
14222026-03-03T18:57:03.488ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
14232026-03-03T18:57:03.489ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14242026-03-03T18:57:03.489ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14252026-03-03T18:57:03.489ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14262026-03-03T18:57:03.497ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
14272026-03-03T18:57:03.497ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14282026-03-03T18:57:03.497ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
14292026-03-03T18:57:03.497ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
14302026-03-03T18:57:03.497ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
14312026-03-03T18:57:03.497ZDEBGtest_metrics: client response result = Ok(Response { url: "http://[::1]:34487/config", status: 204, headers: {"x-request-id": "4c053f50-441b-46ef-a67a-5d53f43101dc", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
14322026-03-03T18:57:03.497ZDEBGtest_metrics (init_with_steps): Running step configure_sled_agents
14332026-03-03T18:57:03.507ZDEBGtest_metrics: client request body = Some(Body) method = PUT uri = http://[::1]:36085/omicron-config
14342026-03-03T18:57:03.507ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = GET remote_addr = [::1]:35792 req_id = 82082dee-2e84-477c-9f91-76e9389aa87d sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
14352026-03-03T18:57:03.507ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = GET remote_addr = [::1]:35792 req_id = 82082dee-2e84-477c-9f91-76e9389aa87d sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
14362026-03-03T18:57:03.508ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35794 req_id = 3ca91202-e4c3-4713-9a5c-df3d2b0f8086 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /probes
14372026-03-03T18:57:03.508ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35794 req_id = 3ca91202-e4c3-4713-9a5c-df3d2b0f8086 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /probes version = 23.0.0
14382026-03-03T18:57:03.509ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 0c 2a 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .*..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:6479 req_id = a21ae03b-cdce-45ed-b5c7-cc5b6fa3c0d3
14392026-03-03T18:57:03.509ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 3114,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:6479 req_id = a21ae03b-cdce-45ed-b5c7-cc5b6fa3c0d3
14402026-03-03T18:57:03.509ZDEBGtest_metrics (store): query key key = _mgs._tcp
14412026-03-03T18:57:03.509ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
14422026-03-03T18:57:03.509ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:6479 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42517, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = a21ae03b-cdce-45ed-b5c7-cc5b6fa3c0d3
14432026-03-03T18:57:03.509ZINFOtest_metrics (dropshot): request completed latency_us = 1687 local_addr = [::1]:36085 method = GET remote_addr = [::1]:35792 req_id = 82082dee-2e84-477c-9f91-76e9389aa87d response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
14442026-03-03T18:57:03.509ZINFOtest_metrics (dropshot): request completed latency_us = 1648 local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35794 req_id = 3ca91202-e4c3-4713-9a5c-df3d2b0f8086 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /probes
14452026-03-03T18:57:03.509ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
14462026-03-03T18:57:03.509ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
14472026-03-03T18:57:03.510ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14482026-03-03T18:57:03.510ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14492026-03-03T18:57:03.510ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14502026-03-03T18:57:03.511ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14512026-03-03T18:57:03.516ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
14522026-03-03T18:57:03.516ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
14532026-03-03T18:57:03.516ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
14542026-03-03T18:57:03.517ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
14552026-03-03T18:57:03.518ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35796 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14562026-03-03T18:57:03.519ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42517, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1960, tv_nsec: 783849732 } })
14572026-03-03T18:57:03.519ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
14582026-03-03T18:57:03.519ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:36085/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "82082dee-2e84-477c-9f91-76e9389aa87d", "content-length": "2", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
14592026-03-03T18:57:03.519ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
14602026-03-03T18:57:03.519ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14612026-03-03T18:57:03.520ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14622026-03-03T18:57:03.520ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = probe_distributor result = Ok(Response { url: "http://[::1]:36085/probes", status: 204, headers: {"x-request-id": "3ca91202-e4c3-4713-9a5c-df3d2b0f8086", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
14632026-03-03T18:57:03.520ZDEBGtest_metrics (BackgroundTasks): Update set of probes on sled background_task = probe_distributor n_probes = 0 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14642026-03-03T18:57:03.520ZINFOtest_metrics (BackgroundTasks): finished distributing probes to sleds background_task = probe_distributor n_pushed_probes = 0
14652026-03-03T18:57:03.521ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = probe_distributor elapsed = 1.49116377s iteration = 1 status = {"errors":[],"probes_by_sled":{"b6d65341-167c-41df-9b5c-41cded99c229":0}}
14662026-03-03T18:57:03.522ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
14672026-03-03T18:57:03.522ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14682026-03-03T18:57:03.522ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
14692026-03-03T18:57:03.522ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
14702026-03-03T18:57:03.522ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
14712026-03-03T18:57:03.523ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
14722026-03-03T18:57:03.523ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14732026-03-03T18:57:03.523ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14742026-03-03T18:57:03.523ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14752026-03-03T18:57:03.524ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762026-03-03T18:57:03.527ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
14772026-03-03T18:57:03.527ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
14782026-03-03T18:57:03.528ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
14792026-03-03T18:57:03.528ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
14802026-03-03T18:57:03.529ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[::1]:36085/artifacts-config
14812026-03-03T18:57:03.541ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14822026-03-03T18:57:03.541ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14832026-03-03T18:57:03.541ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14842026-03-03T18:57:03.541ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14852026-03-03T18:57:03.541ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35798 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14862026-03-03T18:57:03.541ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35798 req_id = 80258cce-bb5f-4e96-85c6-7e29ac68957c sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts-config
14872026-03-03T18:57:03.541ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35798 req_id = 80258cce-bb5f-4e96-85c6-7e29ac68957c sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts-config version = 23.0.0
14882026-03-03T18:57:03.541ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35796 req_id = 013fdb7a-dfa6-4785-9047-4867d62ed664 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /omicron-config
14892026-03-03T18:57:03.541ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35796 req_id = 013fdb7a-dfa6-4785-9047-4867d62ed664 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /omicron-config version = 23.0.0
14902026-03-03T18:57:03.541ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 84 0c 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:46805 req_id = 97fa58c9-da7c-4043-8230-f76d47139cbc
14912026-03-03T18:57:03.541ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 33804,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:46805 req_id = 97fa58c9-da7c-4043-8230-f76d47139cbc
14922026-03-03T18:57:03.541ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
14932026-03-03T18:57:03.541ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:46805 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 97fa58c9-da7c-4043-8230-f76d47139cbc
14942026-03-03T18:57:03.541ZINFOtest_metrics (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpGaEqDK/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14952026-03-03T18:57:03.541ZDEBGtest_metrics (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpGaEqDK/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14962026-03-03T18:57:03.541ZINFOtest_metrics (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpcnvX1z/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14972026-03-03T18:57:03.541ZDEBGtest_metrics (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpcnvX1z/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14982026-03-03T18:57:03.541ZINFOtest_metrics (ArtifactStore): Writing ledger to /var/tmp/omicron_tmp/.tmpGaEqDK/.artifact-config.json.tmp server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14992026-03-03T18:57:03.541ZINFOtest_metrics (ArtifactStore): Writing ledger to /var/tmp/omicron_tmp/.tmpcnvX1z/.artifact-config.json.tmp server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15002026-03-03T18:57:03.541ZINFOtest_metrics (dropshot): request completed latency_us = 2207 local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35796 req_id = 013fdb7a-dfa6-4785-9047-4867d62ed664 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /omicron-config
15012026-03-03T18:57:03.541ZINFOtest_metrics (ArtifactStore): Starting delete reconciler generation = 1 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15022026-03-03T18:57:03.541ZINFOtest_metrics (dropshot): request completed latency_us = 2498 local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35798 req_id = 80258cce-bb5f-4e96-85c6-7e29ac68957c response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts-config
15032026-03-03T18:57:03.541ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15042026-03-03T18:57:03.545ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15052026-03-03T18:57:03.545ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "Vpc" using built-in user background_task = service_firewall_rule_propagation
15062026-03-03T18:57:03.545ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15072026-03-03T18:57:03.545ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15082026-03-03T18:57:03.545ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15092026-03-03T18:57:03.550ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15102026-03-03T18:57:03.555ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15112026-03-03T18:57:03.555ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
15122026-03-03T18:57:03.555ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15132026-03-03T18:57:03.555ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
15142026-03-03T18:57:03.555ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15152026-03-03T18:57:03.555ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
15162026-03-03T18:57:03.593ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
15172026-03-03T18:57:03.601ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[::1]:36085/artifacts-config", status: 204, headers: {"x-request-id": "80258cce-bb5f-4e96-85c6-7e29ac68957c", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
15182026-03-03T18:57:03.601ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = tuf_artifact_replication body = None method = GET uri = http://[::1]:36085/artifacts
15192026-03-03T18:57:03.601ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15202026-03-03T18:57:03.601ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15212026-03-03T18:57:03.602ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15222026-03-03T18:57:03.602ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15232026-03-03T18:57:03.605ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15242026-03-03T18:57:03.605ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
15252026-03-03T18:57:03.605ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15262026-03-03T18:57:03.606ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
15272026-03-03T18:57:03.613ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15282026-03-03T18:57:03.613ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15292026-03-03T18:57:03.613ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15302026-03-03T18:57:03.623ZINFOtest_metrics (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager sled = SimGimlet00
15312026-03-03T18:57:03.627ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:36085/eip-gateways
15322026-03-03T18:57:03.636ZDEBGtest_metrics: client response result = Ok(Response { url: "http://[::1]:36085/omicron-config", status: 204, headers: {"x-request-id": "013fdb7a-dfa6-4785-9047-4867d62ed664", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
15332026-03-03T18:57:03.636ZDEBGtest_metrics: client request body = Some(Body) method = PUT uri = http://[::1]:36085/network-bootstore-config
15342026-03-03T18:57:03.636ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = GET remote_addr = [::1]:35798 req_id = df7c3668-7ed8-435e-95c4-b3ee15276790 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts
15352026-03-03T18:57:03.636ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = GET remote_addr = [::1]:35798 req_id = df7c3668-7ed8-435e-95c4-b3ee15276790 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts version = 23.0.0
15362026-03-03T18:57:03.637ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35792 req_id = 54510450-35d7-4123-a550-be8a1b366e71 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
15372026-03-03T18:57:03.637ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35792 req_id = 54510450-35d7-4123-a550-be8a1b366e71 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways version = 23.0.0
15382026-03-03T18:57:03.637ZINFOtest_metrics (dropshot): request completed latency_us = 556 local_addr = [::1]:36085 method = GET remote_addr = [::1]:35798 req_id = df7c3668-7ed8-435e-95c4-b3ee15276790 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts
15392026-03-03T18:57:03.637ZINFOtest_metrics (dropshot): request completed latency_us = 470 local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35792 req_id = 54510450-35d7-4123-a550-be8a1b366e71 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
15402026-03-03T18:57:03.637ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35796 req_id = f45d5fe4-d2f9-4d63-acc1-cfb6cf3cf4e2 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /network-bootstore-config
15412026-03-03T18:57:03.637ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35796 req_id = f45d5fe4-d2f9-4d63-acc1-cfb6cf3cf4e2 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /network-bootstore-config version = 23.0.0
15422026-03-03T18:57:03.637ZTRACtest_metrics (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 06 6e 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c .n..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:23381 req_id = cbd9a678-25df-47a3-bbdc-635d453a21eb
15432026-03-03T18:57:03.637ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 1646,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:23381 req_id = cbd9a678-25df-47a3-bbdc-635d453a21eb
15442026-03-03T18:57:03.638ZDEBGtest_metrics (store): query key key = _clickhouse-admin-keeper._tcp
15452026-03-03T18:57:03.638ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1646, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal kind = dns peer_addr = [::1]:23381 req_id = cbd9a678-25df-47a3-bbdc-635d453a21eb
15462026-03-03T18:57:03.646ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[::1]:36085/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "df7c3668-7ed8-435e-95c4-b3ee15276790", "content-length": "26", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
15472026-03-03T18:57:03.646ZINFOtest_metrics (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication sled = http://[::1]:36085
15482026-03-03T18:57:03.646ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:36085/eip-gateways", status: 204, headers: {"x-request-id": "54510450-35d7-4123-a550-be8a1b366e71", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
15492026-03-03T18:57:03.646ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 1.624122323s iteration = 1 status = {}
15502026-03-03T18:57:03.646ZDEBGtest_metrics (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Dependency
15512026-03-03T18:57:03.646ZINFOtest_metrics (BackgroundTasks): VPC route manager running background_task = vpc_route_manager
15522026-03-03T18:57:03.646ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
15532026-03-03T18:57:03.646ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15542026-03-03T18:57:03.646ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
15552026-03-03T18:57:03.646ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15562026-03-03T18:57:03.647ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15572026-03-03T18:57:03.647ZINFOtest_metrics (dropshot): request completed latency_us = 10011 local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35796 req_id = f45d5fe4-d2f9-4d63-acc1-cfb6cf3cf4e2 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /network-bootstore-config
15582026-03-03T18:57:03.648ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 1.62182228s iteration = 1 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"b6d65341-167c-41df-9b5c-41cded99c229","time":"2026-03-03T18:57:03.601134090Z"},{"operation":"list","target_sled":"b6d65341-167c-41df-9b5c-41cded99c229","time":"2026-03-03T18:57:03.646256389Z"}]}
15592026-03-03T18:57:03.651ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15602026-03-03T18:57:03.651ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15612026-03-03T18:57:03.653ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15622026-03-03T18:57:03.653ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15632026-03-03T18:57:03.655ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15642026-03-03T18:57:03.655ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
15652026-03-03T18:57:03.655ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15662026-03-03T18:57:03.655ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
15672026-03-03T18:57:03.655ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15682026-03-03T18:57:03.659ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15692026-03-03T18:57:03.660ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15702026-03-03T18:57:03.663ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15712026-03-03T18:57:03.663ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
15722026-03-03T18:57:03.663ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15732026-03-03T18:57:03.664ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15742026-03-03T18:57:03.670ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
15752026-03-03T18:57:03.670ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
15762026-03-03T18:57:03.670ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15772026-03-03T18:57:03.670ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15782026-03-03T18:57:03.670ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15792026-03-03T18:57:03.673ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal
15802026-03-03T18:57:03.674ZDEBGtest_metrics: client response result = Ok(Response { url: "http://[::1]:36085/network-bootstore-config", status: 204, headers: {"x-request-id": "f45d5fe4-d2f9-4d63-acc1-cfb6cf3cf4e2", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
15812026-03-03T18:57:03.674ZDEBGtest_metrics (init_with_steps): Running step start_nexus_external
15822026-03-03T18:57:03.674ZDEBGtest_metrics: Starting Nexus (external API)
15832026-03-03T18:57:03.675ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
15842026-03-03T18:57:03.675ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15852026-03-03T18:57:03.675ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15862026-03-03T18:57:03.675ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15872026-03-03T18:57:03.701ZTRACtest_metrics (dns): buffer buffer = Length: 73 (0x49) bytes\n0000: 03 26 01 00 00 01 00 00 00 00 00 01 0a 5f 63 6f .&..........._co\n0010: 63 6b 72 6f 61 63 68 04 5f 74 63 70 0d 63 6f 6e ckroach._tcp.con\n0020: 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 trol-plane.oxide\n0030: 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 .internal..!....\n0040: 29 04 d0 00 00 00 00 00 00 )........ kind = dns peer_addr = [::1]:28505 req_id = cdc6696b-258d-49cc-8353-7dae2b83c1e1
15882026-03-03T18:57:03.702ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 806,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_cockroach._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_cockroach._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:28505 req_id = cdc6696b-258d-49cc-8353-7dae2b83c1e1
15892026-03-03T18:57:03.702ZDEBGtest_metrics (store): query key key = _cockroach._tcp
15902026-03-03T18:57:03.702ZDEBGtest_metrics (store): query key key = 8b178ee8-bb89-4436-88d8-e2f462915df4.host
15912026-03-03T18:57:03.702ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:28505 query = LowerQuery { name: LowerName(Name("_cockroach._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43291, target: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal") }) }] req_id = cdc6696b-258d-49cc-8353-7dae2b83c1e1
15922026-03-03T18:57:03.714ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = None method = GET uri = http://[::1]:36085/v2p
15932026-03-03T18:57:03.714ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15942026-03-03T18:57:03.714ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15952026-03-03T18:57:03.714ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15962026-03-03T18:57:03.714ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15972026-03-03T18:57:03.716ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15982026-03-03T18:57:03.721ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
15992026-03-03T18:57:03.721ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = service_firewall_rule_propagation
16002026-03-03T18:57:03.721ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
16012026-03-03T18:57:03.721ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
16022026-03-03T18:57:03.721ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16032026-03-03T18:57:03.721ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16042026-03-03T18:57:03.722ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16052026-03-03T18:57:03.723ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43291, target: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1960, tv_nsec: 987928155 } })
16062026-03-03T18:57:03.723ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
16072026-03-03T18:57:03.723ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35802 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
16082026-03-03T18:57:03.724ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = GET remote_addr = [::1]:35802 req_id = a166781f-6178-4429-9e99-5bc574a699ac sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
16092026-03-03T18:57:03.724ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = GET remote_addr = [::1]:35802 req_id = a166781f-6178-4429-9e99-5bc574a699ac sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p version = 23.0.0
16102026-03-03T18:57:03.724ZINFOtest_metrics (dropshot): request completed latency_us = 207 local_addr = [::1]:36085 method = GET remote_addr = [::1]:35802 req_id = a166781f-6178-4429-9e99-5bc574a699ac response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
16112026-03-03T18:57:03.724ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: ba 03 01 00 00 01 00 00 00 00 00 01 24 38 62 31 ............$8b1\n0010: 37 38 65 65 38 2d 62 62 38 39 2d 34 34 33 36 2d 78ee8-bb89-4436-\n0020: 38 38 64 38 2d 65 32 66 34 36 32 39 31 35 64 66 88d8-e2f462915df\n0030: 34 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 4.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:61488 req_id = ae591b8c-5d72-4ce2-8c72-eb99f024aa11
16122026-03-03T18:57:03.724ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 47619,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 56,\n 98,\n 49,\n 55,\n 56,\n 101,\n 101,\n 56,\n 45,\n 98,\n 98,\n 56,\n 57,\n 45,\n 52,\n 52,\n 51,\n 54,\n 45,\n 56,\n 56,\n 100,\n 56,\n 45,\n 101,\n 50,\n 102,\n 52,\n 54,\n 50,\n 57,\n 49,\n 53,\n 100,\n 102,\n 52,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:61488 req_id = ae591b8c-5d72-4ce2-8c72-eb99f024aa11
16132026-03-03T18:57:03.724ZDEBGtest_metrics (store): query key key = 8b178ee8-bb89-4436-88d8-e2f462915df4.host
16142026-03-03T18:57:03.724ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:61488 query = LowerQuery { name: LowerName(Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal.")), original: Query { name: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = ae591b8c-5d72-4ce2-8c72-eb99f024aa11
16152026-03-03T18:57:03.724ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:36085/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a166781f-6178-4429-9e99-5bc574a699ac", "content-length": "2", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
16162026-03-03T18:57:03.725ZINFOtest_metrics (BackgroundTasks): found opte v2p mappings background_task = v2p_manager interfaces = {} sled = SimGimlet00
16172026-03-03T18:57:03.725ZINFOtest_metrics (BackgroundTasks): v2p mappings to delete background_task = v2p_manager mappings = [] sled = SimGimlet00
16182026-03-03T18:57:03.725ZINFOtest_metrics (BackgroundTasks): v2p mappings to add background_task = v2p_manager mappings = [] sled = SimGimlet00
16192026-03-03T18:57:03.725ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 1.705984759s iteration = 1 status = {}
16202026-03-03T18:57:03.725ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
16212026-03-03T18:57:03.725ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16222026-03-03T18:57:03.725ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16232026-03-03T18:57:03.725ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16242026-03-03T18:57:03.726ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
16252026-03-03T18:57:03.726ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16262026-03-03T18:57:03.726ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16272026-03-03T18:57:03.727ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16282026-03-03T18:57:03.727ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16292026-03-03T18:57:03.744ZDEBGtest_metrics (CockroachClusterAdminClient): Updated CockroachDB cluster backends added = 1 addresses = [[::1]:32222] removed = 0 total = 1
16302026-03-03T18:57:03.744ZDEBGtest_metrics (BackgroundTasks): begin collection background_task = inventory_collection
16312026-03-03T18:57:03.744ZDEBGtest_metrics (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:42517
16322026-03-03T18:57:03.744ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/ignition
16332026-03-03T18:57:03.748ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16342026-03-03T18:57:03.748ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16352026-03-03T18:57:03.748ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16362026-03-03T18:57:03.752ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16372026-03-03T18:57:03.752ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e93770b-59ce-403e-86a5-90b614b2934f", "content-length": "835", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
16382026-03-03T18:57:03.752ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0
16392026-03-03T18:57:03.753ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f61ad6a-7f53-4130-8d62-0f7285305e77", "content-length": "734", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
16402026-03-03T18:57:03.753ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=0
16412026-03-03T18:57:03.762ZINFOtest_metrics (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager
16422026-03-03T18:57:03.762ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = None method = GET uri = http://[::1]:36085/vpc-routes
16432026-03-03T18:57:03.763ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16442026-03-03T18:57:03.768ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
16452026-03-03T18:57:03.768ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16462026-03-03T18:57:03.768ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16472026-03-03T18:57:03.769ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16482026-03-03T18:57:03.772ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16492026-03-03T18:57:03.772ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16502026-03-03T18:57:03.773ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16512026-03-03T18:57:03.775ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16522026-03-03T18:57:03.776ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
16532026-03-03T18:57:03.777ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16542026-03-03T18:57:03.777ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16552026-03-03T18:57:03.777ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16562026-03-03T18:57:03.778ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35804 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
16572026-03-03T18:57:03.778ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16582026-03-03T18:57:03.778ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16592026-03-03T18:57:03.778ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16602026-03-03T18:57:03.782ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = GET remote_addr = [::1]:35804 req_id = ae8ccab2-690c-42da-820a-82099e1674ee sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
16612026-03-03T18:57:03.782ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = GET remote_addr = [::1]:35804 req_id = ae8ccab2-690c-42da-820a-82099e1674ee sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
16622026-03-03T18:57:03.782ZINFOtest_metrics (dropshot): request completed latency_us = 280 local_addr = [::1]:36085 method = GET remote_addr = [::1]:35804 req_id = ae8ccab2-690c-42da-820a-82099e1674ee response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
16632026-03-03T18:57:03.782ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16642026-03-03T18:57:03.782ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16652026-03-03T18:57:03.782ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16662026-03-03T18:57:03.783ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:36085/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae8ccab2-690c-42da-820a-82099e1674ee", "content-length": "2", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
16672026-03-03T18:57:03.783ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
16682026-03-03T18:57:03.783ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16692026-03-03T18:57:03.783ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16702026-03-03T18:57:03.818ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16712026-03-03T18:57:03.818ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16722026-03-03T18:57:03.819ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16732026-03-03T18:57:03.821ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "48bef00c-8a32-4281-8a63-61ac918fec50", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
16742026-03-03T18:57:03.821ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=1
16752026-03-03T18:57:03.823ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a13e640-33db-4a90-a553-b169e940d51c", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
16762026-03-03T18:57:03.823ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=0
16772026-03-03T18:57:03.828ZINFOtest_metrics (InternalApi): set cockroachdb setting setting = cluster.preserve_downgrade_option value = 22.1
16782026-03-03T18:57:03.830ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16792026-03-03T18:57:03.830ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16802026-03-03T18:57:03.830ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16812026-03-03T18:57:03.830ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16822026-03-03T18:57:03.830ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16832026-03-03T18:57:03.830ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16842026-03-03T18:57:03.832ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
16852026-03-03T18:57:03.832ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
16862026-03-03T18:57:03.832ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16872026-03-03T18:57:03.832ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16882026-03-03T18:57:03.834ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16892026-03-03T18:57:03.836ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
16902026-03-03T18:57:03.836ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16912026-03-03T18:57:03.836ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16922026-03-03T18:57:03.836ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16932026-03-03T18:57:03.836ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16942026-03-03T18:57:03.836ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
16952026-03-03T18:57:03.836ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16962026-03-03T18:57:03.836ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16972026-03-03T18:57:03.836ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16982026-03-03T18:57:03.836ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16992026-03-03T18:57:03.836ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17002026-03-03T18:57:03.836ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17012026-03-03T18:57:03.836ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17022026-03-03T18:57:03.838ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17032026-03-03T18:57:03.844ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
17042026-03-03T18:57:03.844ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = service_firewall_rule_propagation
17052026-03-03T18:57:03.844ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
17062026-03-03T18:57:03.844ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
17072026-03-03T18:57:03.844ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17082026-03-03T18:57:03.844ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17092026-03-03T18:57:03.844ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17102026-03-03T18:57:03.844ZINFOtest_metrics (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager sled = SimGimlet00
17112026-03-03T18:57:03.845ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:36085/eip-gateways
17122026-03-03T18:57:03.845ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
17132026-03-03T18:57:03.845ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17142026-03-03T18:57:03.845ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17152026-03-03T18:57:03.846ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17162026-03-03T18:57:03.846ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17172026-03-03T18:57:03.852ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
17182026-03-03T18:57:03.852ZDEBGtest_metrics (InternalApi): updating rack subnet for rack c19a698f-c6f9-4a17-ae30-20d711b8f7dc to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), )
17192026-03-03T18:57:03.852ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17202026-03-03T18:57:03.852ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17212026-03-03T18:57:03.852ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17222026-03-03T18:57:03.852ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35804 req_id = 34e98cad-1077-48a7-a572-7942743a703b sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
17232026-03-03T18:57:03.852ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35804 req_id = 34e98cad-1077-48a7-a572-7942743a703b sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways version = 23.0.0
17242026-03-03T18:57:03.852ZINFOtest_metrics (dropshot): request completed latency_us = 542 local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35804 req_id = 34e98cad-1077-48a7-a572-7942743a703b response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
17252026-03-03T18:57:03.852ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17262026-03-03T18:57:03.852ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17272026-03-03T18:57:03.852ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17282026-03-03T18:57:03.852ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17292026-03-03T18:57:03.855ZINFOtest_metrics (InternalApi): Using static configuration for external switchports
17302026-03-03T18:57:03.855ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17312026-03-03T18:57:03.855ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17322026-03-03T18:57:03.855ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17332026-03-03T18:57:03.856ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:36085/eip-gateways", status: 204, headers: {"x-request-id": "34e98cad-1077-48a7-a572-7942743a703b", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17342026-03-03T18:57:03.856ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 209.848973ms iteration = 2 status = {}
17352026-03-03T18:57:03.857ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17362026-03-03T18:57:03.862ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
17372026-03-03T18:57:03.862ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17382026-03-03T18:57:03.862ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17392026-03-03T18:57:03.862ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17402026-03-03T18:57:03.865ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9015c8ce-ba31-4562-9cea-f09f5f33e594", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17412026-03-03T18:57:03.865ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=1
17422026-03-03T18:57:03.867ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "abe7e801-f2ee-435e-8bf3-7cb2e53e5613", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17432026-03-03T18:57:03.867ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=0
17442026-03-03T18:57:03.868ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dec1b44-af2c-49b5-a69b-39d6834c642e", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17452026-03-03T18:57:03.868ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=1
17462026-03-03T18:57:03.869ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0334f637-000d-45e3-a8e6-318d436c8078", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17472026-03-03T18:57:03.869ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cmpa
17482026-03-03T18:57:03.870ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4687a964-af28-4ae5-9239-26697f38743c", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17492026-03-03T18:57:03.871ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
17502026-03-03T18:57:03.871ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "358fd5db-cbf3-4f5a-8c52-aef92c308db5", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17512026-03-03T18:57:03.871ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
17522026-03-03T18:57:03.872ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b734d91a-f60c-4286-97fa-3f3f0f8de32d", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17532026-03-03T18:57:03.872ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
17542026-03-03T18:57:03.872ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d1b5a66-49cc-4482-8759-f7b27eb8be13", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17552026-03-03T18:57:03.872ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1
17562026-03-03T18:57:03.873ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "260ffeb9-231e-45e3-b222-60894b315d54", "content-length": "734", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17572026-03-03T18:57:03.873ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=0
17582026-03-03T18:57:03.874ZDEBGtest_metrics (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
17592026-03-03T18:57:03.874ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Fleet
17602026-03-03T18:57:03.874ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17612026-03-03T18:57:03.874ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17622026-03-03T18:57:03.874ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17632026-03-03T18:57:03.874ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17642026-03-03T18:57:03.879ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17652026-03-03T18:57:03.882ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
17662026-03-03T18:57:03.885ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17672026-03-03T18:57:03.885ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17682026-03-03T18:57:03.885ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17692026-03-03T18:57:03.885ZTRACtest_metrics (service-firewall-rule-progator): fetched allowlist from DB allowed = AllowList { id: 001de000-a110-4000-8000-000000000000, time_created: 2026-03-03T18:36:54.041040Z, time_modified: 2026-03-03T18:36:54.041040Z, allowed_ips: None } background_task = service_firewall_rule_propagation
17702026-03-03T18:57:03.885ZDEBGtest_metrics (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
17712026-03-03T18:57:03.885ZDEBGtest_metrics (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
17722026-03-03T18:57:03.885ZDEBGtest_metrics (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
17732026-03-03T18:57:03.889ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c4cfefc-7ef4-4bfb-8437-a62799d645ad", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17742026-03-03T18:57:03.889ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=1
17752026-03-03T18:57:03.890ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d56c61da-9d24-4abf-baf5-941562dd2272", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17762026-03-03T18:57:03.890ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=0
17772026-03-03T18:57:03.893ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "51f50bb2-530b-415e-a438-865287ec5191", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17782026-03-03T18:57:03.894ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=1
17792026-03-03T18:57:03.894ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "125f2906-319b-4da6-920c-beac8f601cdc", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17802026-03-03T18:57:03.894ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=0
17812026-03-03T18:57:03.904ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e60d9d3d-ef57-4624-8e88-4b41c4e755ff", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17822026-03-03T18:57:03.904ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=1
17832026-03-03T18:57:03.905ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17842026-03-03T18:57:03.905ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17852026-03-03T18:57:03.905ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17862026-03-03T18:57:03.908ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "506006ba-afa3-4e8f-9e72-766019c34252", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17872026-03-03T18:57:03.908ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cmpa
17882026-03-03T18:57:03.908ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "739b4684-e718-4a05-8b49-675ff1b32371", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17892026-03-03T18:57:03.909ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
17902026-03-03T18:57:03.911ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a296c794-cfa1-4984-aacd-c9248dc420b2", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17912026-03-03T18:57:03.911ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
17922026-03-03T18:57:03.911ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c43ac4dd-6a60-4480-9db0-e4f108653ca1", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17932026-03-03T18:57:03.911ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
17942026-03-03T18:57:03.911ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d37e1270-ecb6-49b0-a447-8943d55adc60", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17952026-03-03T18:57:03.911ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0
17962026-03-03T18:57:03.911ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7511e55a-c58c-4bd1-9240-34b0b4f4529a", "content-length": "723", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17972026-03-03T18:57:03.911ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/active-slot
17982026-03-03T18:57:03.912ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "a87a1178-d68d-4d21-84ef-9b2763fc8234", "content-length": "10", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
17992026-03-03T18:57:03.912ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/0
18002026-03-03T18:57:03.913ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1485bcb9-53c8-4d42-9cc5-83fdc7818f36", "content-length": "144", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18012026-03-03T18:57:03.913ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/1
18022026-03-03T18:57:03.916ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "78d41df1-3a84-4ff6-a48f-2195daedd109", "content-length": "147", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18032026-03-03T18:57:03.916ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=0
18042026-03-03T18:57:03.916ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a78419c8-87e9-4943-9430-a69406f350a1", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18052026-03-03T18:57:03.916ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=1
18062026-03-03T18:57:03.916ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b469a9e-a624-4857-8e6f-e0c86f25da75", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18072026-03-03T18:57:03.916ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=0
18082026-03-03T18:57:03.918ZINFOtest_metrics (InternalApi): Recording Rack Network Configuration
18092026-03-03T18:57:03.918ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
18102026-03-03T18:57:03.918ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
18112026-03-03T18:57:03.919ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
18122026-03-03T18:57:03.920ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1eacefc-1728-47cf-a4c6-8e7b01574b81", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18132026-03-03T18:57:03.920ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=1
18142026-03-03T18:57:03.921ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3af5799-831e-4a11-8163-ed6d590ee8c1", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18152026-03-03T18:57:03.921ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=0
18162026-03-03T18:57:03.922ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a198ecb9-4291-4e05-927d-d8ee50cd4324", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18172026-03-03T18:57:03.922ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=1
18182026-03-03T18:57:03.923ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e7ee4c7-0542-45df-a58e-1aedf4a69b36", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18192026-03-03T18:57:03.924ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cmpa
18202026-03-03T18:57:03.924ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1303cf4-87e3-4cb4-92a3-566b9d344997", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18212026-03-03T18:57:03.924ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
18222026-03-03T18:57:03.925ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d53f22df-137f-4b25-a6d0-196990d07f86", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18232026-03-03T18:57:03.925ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
18242026-03-03T18:57:03.926ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c885416c-76c6-43e0-8c13-7fc0b252ccb1", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18252026-03-03T18:57:03.926ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
18262026-03-03T18:57:03.926ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2309a44-ecb5-4053-ac71-f4dd5a751a48", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18272026-03-03T18:57:03.927ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1
18282026-03-03T18:57:03.927ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "248f7235-e602-48b3-a233-afeb05a45735", "content-length": "723", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18292026-03-03T18:57:03.928ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/active-slot
18302026-03-03T18:57:03.928ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6f6b0f5-88a7-4e57-8c72-a98524752127", "content-length": "10", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18312026-03-03T18:57:03.928ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/0
18322026-03-03T18:57:03.929ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2ee46df-fb3a-4327-a8d2-7150e6810d44", "content-length": "144", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18332026-03-03T18:57:03.929ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/1
18342026-03-03T18:57:03.930ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "90c14254-1dfb-4274-a0df-f5f382f611b7", "content-length": "147", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18352026-03-03T18:57:03.930ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=0
18362026-03-03T18:57:03.931ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7814c20-dc50-4ca1-9027-c53496ebf0f3", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18372026-03-03T18:57:03.931ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=1
18382026-03-03T18:57:03.932ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5108dc77-db5b-4b46-8d79-d4a72b1e98ba", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18392026-03-03T18:57:03.932ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=0
18402026-03-03T18:57:03.933ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f447291f-f13f-42b9-ba11-7a3ee777cc9e", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18412026-03-03T18:57:03.933ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=1
18422026-03-03T18:57:03.934ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e6b1862-b084-498b-b0d0-4acfabd887ca", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18432026-03-03T18:57:03.934ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=0
18442026-03-03T18:57:03.935ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5292f743-c58e-42e1-a3bf-fde0af1f6407", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18452026-03-03T18:57:03.935ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=1
18462026-03-03T18:57:03.936ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a01109ce-f28c-4555-a8c9-4c2516a8de9b", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18472026-03-03T18:57:03.936ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cmpa
18482026-03-03T18:57:03.937ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "50c50c1b-ecb6-4a93-82bc-a9cfc5abe72c", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18492026-03-03T18:57:03.937ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
18502026-03-03T18:57:03.938ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4f62dc7-403d-49d9-a2cf-22867dde8897", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18512026-03-03T18:57:03.938ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
18522026-03-03T18:57:03.939ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7c33ab8-9c48-45a2-8f06-61268960b8b8", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18532026-03-03T18:57:03.939ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
18542026-03-03T18:57:03.939ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "be6bd8ab-90d9-4b4d-b7ef-7336880d3c65", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18552026-03-03T18:57:03.939ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
18562026-03-03T18:57:03.939ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18572026-03-03T18:57:03.939ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
18582026-03-03T18:57:03.939ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18592026-03-03T18:57:03.940ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
18602026-03-03T18:57:03.941ZDEBGtest_metrics (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
18612026-03-03T18:57:03.941ZDEBGtest_metrics (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
18622026-03-03T18:57:03.941ZINFOtest_metrics (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation
18632026-03-03T18:57:03.941ZDEBGtest_metrics (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 1.919755498s
18642026-03-03T18:57:03.941ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 1.919773578s iteration = 1 status = {}
18652026-03-03T18:57:03.942ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18662026-03-03T18:57:03.948ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
18672026-03-03T18:57:03.948ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
18682026-03-03T18:57:03.948ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18692026-03-03T18:57:03.948ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
18702026-03-03T18:57:03.948ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18712026-03-03T18:57:03.949ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
18722026-03-03T18:57:03.950ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18732026-03-03T18:57:03.954ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
18742026-03-03T18:57:03.954ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
18752026-03-03T18:57:03.954ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18762026-03-03T18:57:03.954ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
18772026-03-03T18:57:03.965ZDEBGtest_metrics (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:36085
18782026-03-03T18:57:03.965ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = http://[::1]:36085 background_task = inventory_collection body = None method = GET uri = http://[::1]:36085/inventory
18792026-03-03T18:57:03.966ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35806 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
18802026-03-03T18:57:03.967ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = GET remote_addr = [::1]:35806 req_id = b65d7fa6-d43c-4205-a3b5-da6be2909be8 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
18812026-03-03T18:57:03.967ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = GET remote_addr = [::1]:35806 req_id = b65d7fa6-d43c-4205-a3b5-da6be2909be8 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory version = 23.0.0
18822026-03-03T18:57:03.968ZINFOtest_metrics (dropshot): request completed latency_us = 1094 local_addr = [::1]:36085 method = GET remote_addr = [::1]:35806 req_id = b65d7fa6-d43c-4205-a3b5-da6be2909be8 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
18832026-03-03T18:57:03.968ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = http://[::1]:36085 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:36085/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "b65d7fa6-d43c-4205-a3b5-da6be2909be8", "content-length": "20607", "date": "Tue, 03 Mar 2026 18:57:03 GMT"} })
18842026-03-03T18:57:03.970ZDEBGtest_metrics (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
18852026-03-03T18:57:03.970ZDEBGtest_metrics (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
18862026-03-03T18:57:03.970ZDEBGtest_metrics (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
18872026-03-03T18:57:03.970ZDEBGtest_metrics (CockroachClusterAdminClient): client request body = None method = GET uri = http://[::1]:32222/node/id
18882026-03-03T18:57:03.970ZDEBGtest_metrics (CockroachClusterAdminClient): client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
18892026-03-03T18:57:03.970ZWARNtest_metrics (CockroachClusterAdminClient): Failed to fetch metrics from CockroachDB node error = Failed to get node ID from [::1]:32222
18902026-03-03T18:57:03.997ZDEBGtest_metrics (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[::1]:10123 zone_id = 128cd5ee-2d78-44f6-9fb4-83dda8b3d1a4 (omicron_zone)
18912026-03-03T18:57:03.997ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[::1]:10123 uri = http://[::1]:10123/timesync
18922026-03-03T18:57:03.997ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[::1]:10123 result = Err(reqwest::Error { kind: Request, url: "http://[::1]:10123/timesync", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:10123, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
18932026-03-03T18:57:03.997ZDEBGtest_metrics (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
18942026-03-03T18:57:04.007ZDEBGtest_metrics (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 2a83ee47-a98f-4924-a414-6bdba496b84f (omicron_zone)
18952026-03-03T18:57:04.009ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[::1]:34487 method = GET uri = http://[::1]:34487/config
18962026-03-03T18:57:04.011ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:34487 remote_addr = [::1]:39238
18972026-03-03T18:57:04.011ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:34487 method = GET remote_addr = [::1]:39238 req_id = a6bbc2ab-b6de-4631-952d-fd96ba78ee5c uri = /config
18982026-03-03T18:57:04.011ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:34487 method = GET remote_addr = [::1]:39238 req_id = a6bbc2ab-b6de-4631-952d-fd96ba78ee5c uri = /config version = 2.0.0
18992026-03-03T18:57:04.013ZINFOtest_metrics (http): request completed kind = dns latency_us = 1481 local_addr = [::1]:34487 method = GET remote_addr = [::1]:39238 req_id = a6bbc2ab-b6de-4631-952d-fd96ba78ee5c response_code = 200 uri = /config
19002026-03-03T18:57:04.013ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
19012026-03-03T18:57:04.013ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19022026-03-03T18:57:04.013ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19032026-03-03T18:57:04.013ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19042026-03-03T18:57:04.015ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19052026-03-03T18:57:04.015ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[::1]:34487 result = Ok(Response { url: "http://[::1]:34487/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6bbc2ab-b6de-4631-952d-fd96ba78ee5c", "content-length": "3478", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
19062026-03-03T18:57:04.015ZDEBGtest_metrics (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 2a83ee47-a98f-4924-a414-6bdba496b84f (omicron_zone)
19072026-03-03T18:57:04.015ZDEBGtest_metrics (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
19082026-03-03T18:57:04.015ZDEBGtest_metrics (BackgroundTasks): finished collection background_task = inventory_collection
19092026-03-03T18:57:04.016ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
19102026-03-03T18:57:04.016ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19112026-03-03T18:57:04.016ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
19122026-03-03T18:57:04.016ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
19132026-03-03T18:57:04.017ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
19142026-03-03T18:57:04.033ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19152026-03-03T18:57:04.036ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
19162026-03-03T18:57:04.036ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19172026-03-03T18:57:04.036ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19182026-03-03T18:57:04.036ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19192026-03-03T18:57:04.037ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19202026-03-03T18:57:04.040ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
19212026-03-03T18:57:04.040ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
19222026-03-03T18:57:04.040ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
19232026-03-03T18:57:04.041ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
19242026-03-03T18:57:04.057ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 29835b37-fe2f-445d-80d6-d59fdff13861, lookup_type: ByName("oxide-service-pool-v4") }
19252026-03-03T18:57:04.057ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19262026-03-03T18:57:04.060ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19272026-03-03T18:57:04.060ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19282026-03-03T18:57:04.060ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19292026-03-03T18:57:04.064ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19302026-03-03T18:57:04.068ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 29835b37-fe2f-445d-80d6-d59fdff13861, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
19312026-03-03T18:57:04.068ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19322026-03-03T18:57:04.068ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19332026-03-03T18:57:04.068ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19342026-03-03T18:57:04.103ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 0c04520a-bd01-4cc7-a0f8-2557154bba5d, lookup_type: ByName("oxide-service-pool-v6") }
19352026-03-03T18:57:04.103ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19362026-03-03T18:57:04.103ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19372026-03-03T18:57:04.103ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19382026-03-03T18:57:04.103ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19392026-03-03T18:57:04.113ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19402026-03-03T18:57:04.120ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 0c04520a-bd01-4cc7-a0f8-2557154bba5d, lookup_type: ByName("oxide-service-pool-v6") } result = Ok(())
19412026-03-03T18:57:04.120ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19422026-03-03T18:57:04.120ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19432026-03-03T18:57:04.121ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19442026-03-03T18:57:04.133ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 29835b37-fe2f-445d-80d6-d59fdff13861, lookup_type: ByName("oxide-service-pool-v4") }
19452026-03-03T18:57:04.133ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19462026-03-03T18:57:04.134ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19472026-03-03T18:57:04.134ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19482026-03-03T18:57:04.139ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19492026-03-03T18:57:04.139ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19502026-03-03T18:57:04.141ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 29835b37-fe2f-445d-80d6-d59fdff13861, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
19512026-03-03T18:57:04.150ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 29835b37-fe2f-445d-80d6-d59fdff13861, lookup_type: ByName("oxide-service-pool-v4") }
19522026-03-03T18:57:04.150ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19532026-03-03T18:57:04.151ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19542026-03-03T18:57:04.151ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19552026-03-03T18:57:04.151ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19562026-03-03T18:57:04.153ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19572026-03-03T18:57:04.156ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 29835b37-fe2f-445d-80d6-d59fdff13861, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
19582026-03-03T18:57:04.161ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 0c04520a-bd01-4cc7-a0f8-2557154bba5d, lookup_type: ByName("oxide-service-pool-v6") }
19592026-03-03T18:57:04.161ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19602026-03-03T18:57:04.161ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19612026-03-03T18:57:04.161ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19622026-03-03T18:57:04.162ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19632026-03-03T18:57:04.167ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19642026-03-03T18:57:04.174ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 0c04520a-bd01-4cc7-a0f8-2557154bba5d, lookup_type: ByName("oxide-service-pool-v6") } result = Ok(())
19652026-03-03T18:57:04.180ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig
19662026-03-03T18:57:04.180ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19672026-03-03T18:57:04.180ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19682026-03-03T18:57:04.180ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19692026-03-03T18:57:04.181ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19702026-03-03T18:57:04.187ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19712026-03-03T18:57:04.192ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig result = Ok(())
19722026-03-03T18:57:04.312ZINFOtest_metrics (InternalApi): inserted blueprint blueprint_id = a34df21f-b47e-418a-ab97-8a520be16a04
19732026-03-03T18:57:04.312ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig
19742026-03-03T18:57:04.312ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19752026-03-03T18:57:04.312ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19762026-03-03T18:57:04.313ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19772026-03-03T18:57:04.314ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19782026-03-03T18:57:04.316ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19792026-03-03T18:57:04.320ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig result = Ok(())
19802026-03-03T18:57:04.361ZINFOtest_metrics (InternalApi): Inserted networking records for boundary_ntp service
19812026-03-03T18:57:04.362ZINFOtest_metrics (InternalApi): No networking records needed for internal_dns service
19822026-03-03T18:57:04.362ZINFOtest_metrics (InternalApi): No networking records needed for crucible_pantry service
19832026-03-03T18:57:04.362ZINFOtest_metrics (InternalApi): No networking records needed for clickhouse service
19842026-03-03T18:57:04.362ZINFOtest_metrics (InternalApi): No networking records needed for cockroach_db service
19852026-03-03T18:57:04.376ZINFOtest_metrics (InternalApi): Inserted networking records for nexus service
19862026-03-03T18:57:04.393ZINFOtest_metrics (InternalApi): Inserted networking records for external_dns service
19872026-03-03T18:57:04.393ZINFOtest_metrics (InternalApi): Inserted service networking records
19882026-03-03T18:57:04.393ZINFOtest_metrics (InternalApi): Inserted physical disks
19892026-03-03T18:57:04.393ZINFOtest_metrics (InternalApi): Inserted zpools
19902026-03-03T18:57:04.393ZINFOtest_metrics (InternalApi): Inserted datasets
19912026-03-03T18:57:04.401ZINFOtest_metrics (InternalApi): Populated DNS tables for internal DNS
19922026-03-03T18:57:04.410ZINFOtest_metrics (InternalApi): Populated DNS tables for external DNS
19932026-03-03T18:57:04.410ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
19942026-03-03T18:57:04.410ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19952026-03-03T18:57:04.410ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19962026-03-03T18:57:04.410ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19972026-03-03T18:57:04.410ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19982026-03-03T18:57:04.413ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19992026-03-03T18:57:04.414ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
20002026-03-03T18:57:04.414ZTRACtest_metrics (InternalApi): authorize begin action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
20012026-03-03T18:57:04.416ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20022026-03-03T18:57:04.416ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20032026-03-03T18:57:04.416ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20042026-03-03T18:57:04.417ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20052026-03-03T18:57:04.421ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20062026-03-03T18:57:04.422ZDEBGtest_metrics (InternalApi): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
20072026-03-03T18:57:04.438ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig
20082026-03-03T18:57:04.438ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20092026-03-03T18:57:04.438ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20102026-03-03T18:57:04.438ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20112026-03-03T18:57:04.439ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20122026-03-03T18:57:04.442ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20132026-03-03T18:57:04.447ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig result = Ok(())
20142026-03-03T18:57:04.447ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig
20152026-03-03T18:57:04.447ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20162026-03-03T18:57:04.447ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20172026-03-03T18:57:04.447ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20182026-03-03T18:57:04.447ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20192026-03-03T18:57:04.461ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20202026-03-03T18:57:04.465ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig result = Ok(())
20212026-03-03T18:57:04.466ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig
20222026-03-03T18:57:04.466ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20232026-03-03T18:57:04.466ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20242026-03-03T18:57:04.466ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20252026-03-03T18:57:04.467ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20262026-03-03T18:57:04.481ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20272026-03-03T18:57:04.486ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig result = Ok(())
20282026-03-03T18:57:04.493ZINFOtest_metrics (InternalApi): Created recovery silo
20292026-03-03T18:57:04.493ZINFOtest_metrics (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 7b82cae1-bfef-49b5-809c-5be3d97f2f81
20302026-03-03T18:57:04.493ZDEBGtest_metrics (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 7b82cae1-bfef-49b5-809c-5be3d97f2f81 time_started = 2026-03-03 18:57:03.744471 UTC
20312026-03-03T18:57:04.493ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.165058129s iteration = 2 status = {"collection_id":"7b82cae1-bfef-49b5-809c-5be3d97f2f81","time_done":"2026-03-03 18:57:04.015972 UTC","time_started":"2026-03-03 18:57:03.744471 UTC"}
20322026-03-03T18:57:04.493ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 2 reason = Dependency
20332026-03-03T18:57:04.493ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
20342026-03-03T18:57:04.493ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20352026-03-03T18:57:04.493ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
20362026-03-03T18:57:04.493ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
20372026-03-03T18:57:04.493ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
20382026-03-03T18:57:04.496ZINFOtest_metrics (InternalApi): Created recovery user
20392026-03-03T18:57:04.496ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20402026-03-03T18:57:04.500ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
20412026-03-03T18:57:04.500ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
20422026-03-03T18:57:04.500ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
20432026-03-03T18:57:04.501ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
20442026-03-03T18:57:04.502ZINFOtest_metrics (InternalApi): Created recovery user's password
20452026-03-03T18:57:04.502ZTRACtest_metrics (InternalApi): authorize begin action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Silo { parent: Fleet, key: a4da2904-e21b-4644-bf7f-b773ce81644d, lookup_type: ById(a4da2904-e21b-4644-bf7f-b773ce81644d) }
20462026-03-03T18:57:04.502ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = a4da2904-e21b-4644-bf7f-b773ce81644d resource_type = Silo
20472026-03-03T18:57:04.502ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20482026-03-03T18:57:04.502ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20492026-03-03T18:57:04.502ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20502026-03-03T18:57:04.505ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
20512026-03-03T18:57:04.505ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
20522026-03-03T18:57:04.505ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
20532026-03-03T18:57:04.506ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20542026-03-03T18:57:04.506ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20552026-03-03T18:57:04.506ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20562026-03-03T18:57:04.507ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20572026-03-03T18:57:04.508ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20582026-03-03T18:57:04.510ZDEBGtest_metrics (InternalApi): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Silo { parent: Fleet, key: a4da2904-e21b-4644-bf7f-b773ce81644d, lookup_type: ById(a4da2904-e21b-4644-bf7f-b773ce81644d) } result = Ok(())
20592026-03-03T18:57:04.510ZDEBGtest_metrics (InternalApi): Generated role assignment queries
20602026-03-03T18:57:04.511ZINFOtest_metrics (InternalApi): Granted Silo privileges
20612026-03-03T18:57:04.511ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
20622026-03-03T18:57:04.511ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20632026-03-03T18:57:04.511ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20642026-03-03T18:57:04.511ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20652026-03-03T18:57:04.512ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20662026-03-03T18:57:04.513ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20672026-03-03T18:57:04.515ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
20682026-03-03T18:57:04.518ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
20692026-03-03T18:57:04.518ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20702026-03-03T18:57:04.518ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20712026-03-03T18:57:04.518ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20722026-03-03T18:57:04.518ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20732026-03-03T18:57:04.518ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20742026-03-03T18:57:04.521ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
20752026-03-03T18:57:04.521ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
20762026-03-03T18:57:04.521ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20772026-03-03T18:57:04.521ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20782026-03-03T18:57:04.521ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20792026-03-03T18:57:04.521ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20802026-03-03T18:57:04.538ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20812026-03-03T18:57:04.538ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
20822026-03-03T18:57:04.559ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
20832026-03-03T18:57:04.559ZDEBGtest_metrics (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
20842026-03-03T18:57:04.559ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
20852026-03-03T18:57:04.559ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20862026-03-03T18:57:04.560ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20872026-03-03T18:57:04.560ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
20882026-03-03T18:57:04.560ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal
20892026-03-03T18:57:04.561ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
20902026-03-03T18:57:04.561ZDEBGtest_metrics (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
20912026-03-03T18:57:04.561ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
20922026-03-03T18:57:04.561ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20932026-03-03T18:57:04.561ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20942026-03-03T18:57:04.562ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
20952026-03-03T18:57:04.562ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal
20962026-03-03T18:57:04.562ZDEBGtest_metrics (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
20972026-03-03T18:57:04.562ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet
20982026-03-03T18:57:04.562ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20992026-03-03T18:57:04.562ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
21002026-03-03T18:57:04.562ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21012026-03-03T18:57:04.562ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
21022026-03-03T18:57:04.563ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Signaled
21032026-03-03T18:57:04.563ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
21042026-03-03T18:57:04.563ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21052026-03-03T18:57:04.563ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
21062026-03-03T18:57:04.563ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
21072026-03-03T18:57:04.564ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
21082026-03-03T18:57:04.564ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Signaled
21092026-03-03T18:57:04.564ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig
21102026-03-03T18:57:04.564ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21112026-03-03T18:57:04.564ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
21122026-03-03T18:57:04.564ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21132026-03-03T18:57:04.564ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21142026-03-03T18:57:04.566ZTRACtest_metrics (dns): buffer buffer = Length: 75 (0x4b) bytes\n0000: 4d f9 01 00 00 01 00 00 00 00 00 01 0c 5f 6e 61 M............_na\n0010: 6d 65 73 65 72 76 69 63 65 04 5f 74 63 70 0d 63 meservice._tcp.c\n0020: 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 ontrol-plane.oxi\n0030: 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 de.internal..!..\n0040: 00 00 29 04 d0 00 00 00 00 00 00 ..)........ kind = dns peer_addr = [::1]:60403 req_id = 44604fc4-8c57-4de6-959a-c54692e1ddef
21152026-03-03T18:57:04.566ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 19961,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_nameservice._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_nameservice._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 12,\n 95,\n 110,\n 97,\n 109,\n 101,\n 115,\n 101,\n 114,\n 118,\n 105,\n 99,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:60403 req_id = 44604fc4-8c57-4de6-959a-c54692e1ddef
21162026-03-03T18:57:04.566ZDEBGtest_metrics (store): query key key = _nameservice._tcp
21172026-03-03T18:57:04.566ZDEBGtest_metrics (store): query key key = 2a83ee47-a98f-4924-a414-6bdba496b84f.host
21182026-03-03T18:57:04.566ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("2a83ee47-a98f-4924-a414-6bdba496b84f.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:60403 query = LowerQuery { name: LowerName(Name("_nameservice._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34487, target: Name("2a83ee47-a98f-4924-a414-6bdba496b84f.host.control-plane.oxide.internal") }) }] req_id = 44604fc4-8c57-4de6-959a-c54692e1ddef
21192026-03-03T18:57:04.566ZTRACtest_metrics (dns): buffer buffer = Length: 76 (0x4c) bytes\n0000: 25 0c 01 00 00 01 00 00 00 00 00 01 0d 5f 65 78 %............_ex\n0010: 74 65 72 6e 61 6c 2d 64 6e 73 04 5f 74 63 70 0d ternal-dns._tcp.\n0020: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0030: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 ide.internal..!.\n0040: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:1102 req_id = c44b4c10-f70b-4a16-83e3-733e186e1568
21202026-03-03T18:57:04.566ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 9484,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_external-dns._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_external-dns._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 13,\n 95,\n 101,\n 120,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 45,\n 100,\n 110,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:1102 req_id = c44b4c10-f70b-4a16-83e3-733e186e1568
21212026-03-03T18:57:04.566ZDEBGtest_metrics (store): query key key = _external-dns._tcp
21222026-03-03T18:57:04.566ZDEBGtest_metrics (store): query key key = a0b447ac-c7a0-4310-8017-829376663066.host
21232026-03-03T18:57:04.566ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("a0b447ac-c7a0-4310-8017-829376663066.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:1102 query = LowerQuery { name: LowerName(Name("_external-dns._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 46173, target: Name("a0b447ac-c7a0-4310-8017-829376663066.host.control-plane.oxide.internal") }) }] req_id = c44b4c10-f70b-4a16-83e3-733e186e1568
21242026-03-03T18:57:04.566ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34487, target: Name("2a83ee47-a98f-4924-a414-6bdba496b84f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("2a83ee47-a98f-4924-a414-6bdba496b84f.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1961, tv_nsec: 830543739 } })
21252026-03-03T18:57:04.566ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
21262026-03-03T18:57:04.566ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 46173, target: Name("a0b447ac-c7a0-4310-8017-829376663066.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a0b447ac-c7a0-4310-8017-829376663066.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1961, tv_nsec: 830760079 } })
21272026-03-03T18:57:04.566ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
21282026-03-03T18:57:04.566ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
21292026-03-03T18:57:04.566ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21302026-03-03T18:57:04.566ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
21312026-03-03T18:57:04.566ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21322026-03-03T18:57:04.566ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21332026-03-03T18:57:04.567ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21342026-03-03T18:57:04.570ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
21352026-03-03T18:57:04.570ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
21362026-03-03T18:57:04.570ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
21372026-03-03T18:57:04.570ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
21382026-03-03T18:57:04.571ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
21392026-03-03T18:57:04.571ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21402026-03-03T18:57:04.571ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
21412026-03-03T18:57:04.571ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21422026-03-03T18:57:04.572ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21432026-03-03T18:57:04.572ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21442026-03-03T18:57:04.576ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21452026-03-03T18:57:04.576ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
21462026-03-03T18:57:04.576ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21472026-03-03T18:57:04.577ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21482026-03-03T18:57:04.577ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21492026-03-03T18:57:04.580ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21502026-03-03T18:57:04.580ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
21512026-03-03T18:57:04.580ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21522026-03-03T18:57:04.580ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
21532026-03-03T18:57:04.582ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21542026-03-03T18:57:04.586ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21552026-03-03T18:57:04.586ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21562026-03-03T18:57:04.590ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21572026-03-03T18:57:04.590ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a34df21f-b47e-418a-ab97-8a520be16a04, lookup_type: ById(a34df21f-b47e-418a-ab97-8a520be16a04) }
21582026-03-03T18:57:04.591ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21592026-03-03T18:57:04.591ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
21602026-03-03T18:57:04.591ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21612026-03-03T18:57:04.591ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21622026-03-03T18:57:04.592ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(7b82cae1-bfef-49b5-809c-5be3d97f2f81, 2)]
21632026-03-03T18:57:04.592ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
21642026-03-03T18:57:04.593ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig
21652026-03-03T18:57:04.593ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21662026-03-03T18:57:04.593ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
21672026-03-03T18:57:04.593ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21682026-03-03T18:57:04.594ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
21692026-03-03T18:57:04.595ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 9b 29 01 00 00 01 00 00 00 00 00 01 24 32 61 38 .)..........$2a8\n0010: 33 65 65 34 37 2d 61 39 38 66 2d 34 39 32 34 2d 3ee47-a98f-4924-\n0020: 61 34 31 34 2d 36 62 64 62 61 34 39 36 62 38 34 a414-6bdba496b84\n0030: 66 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 f.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:9469 req_id = 982c8c78-aeca-44f4-a9c0-c2135ab0d73f
21702026-03-03T18:57:04.595ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 39721,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("2a83ee47-a98f-4924-a414-6bdba496b84f.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("2a83ee47-a98f-4924-a414-6bdba496b84f.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 50,\n 97,\n 56,\n 51,\n 101,\n 101,\n 52,\n 55,\n 45,\n 97,\n 57,\n 56,\n 102,\n 45,\n 52,\n 57,\n 50,\n 52,\n 45,\n 97,\n 52,\n 49,\n 52,\n 45,\n 54,\n 98,\n 100,\n 98,\n 97,\n 52,\n 57,\n 54,\n 98,\n 56,\n 52,\n 102,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:9469 req_id = 982c8c78-aeca-44f4-a9c0-c2135ab0d73f
21712026-03-03T18:57:04.595ZDEBGtest_metrics (store): query key key = 2a83ee47-a98f-4924-a414-6bdba496b84f.host
21722026-03-03T18:57:04.595ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:9469 query = LowerQuery { name: LowerName(Name("2a83ee47-a98f-4924-a414-6bdba496b84f.host.control-plane.oxide.internal.")), original: Query { name: Name("2a83ee47-a98f-4924-a414-6bdba496b84f.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("2a83ee47-a98f-4924-a414-6bdba496b84f.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 982c8c78-aeca-44f4-a9c0-c2135ab0d73f
21732026-03-03T18:57:04.596ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 0b 24 01 00 00 01 00 00 00 00 00 01 24 61 30 62 .$..........$a0b\n0010: 34 34 37 61 63 2d 63 37 61 30 2d 34 33 31 30 2d 447ac-c7a0-4310-\n0020: 38 30 31 37 2d 38 32 39 33 37 36 36 36 33 30 36 8017-82937666306\n0030: 36 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 6.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:32995 req_id = 80ee0824-fc3a-4a94-80e0-e398adb1a66a
21742026-03-03T18:57:04.596ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 2852,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("a0b447ac-c7a0-4310-8017-829376663066.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("a0b447ac-c7a0-4310-8017-829376663066.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 97,\n 48,\n 98,\n 52,\n 52,\n 55,\n 97,\n 99,\n 45,\n 99,\n 55,\n 97,\n 48,\n 45,\n 52,\n 51,\n 49,\n 48,\n 45,\n 56,\n 48,\n 49,\n 55,\n 45,\n 56,\n 50,\n 57,\n 51,\n 55,\n 54,\n 54,\n 54,\n 51,\n 48,\n 54,\n 54,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:32995 req_id = 80ee0824-fc3a-4a94-80e0-e398adb1a66a
21752026-03-03T18:57:04.596ZDEBGtest_metrics (store): query key key = a0b447ac-c7a0-4310-8017-829376663066.host
21762026-03-03T18:57:04.601ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:32995 query = LowerQuery { name: LowerName(Name("a0b447ac-c7a0-4310-8017-829376663066.host.control-plane.oxide.internal.")), original: Query { name: Name("a0b447ac-c7a0-4310-8017-829376663066.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("a0b447ac-c7a0-4310-8017-829376663066.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 80ee0824-fc3a-4a94-80e0-e398adb1a66a
21772026-03-03T18:57:04.601ZINFOtest_metrics (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[::1]:34487] } background_task = dns_servers_internal dns_group = internal
21782026-03-03T18:57:04.601ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 40.568492ms iteration = 2 status = {"addresses":["[::1]:34487"]}
21792026-03-03T18:57:04.601ZINFOtest_metrics (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[::1]:46173] } background_task = dns_servers_external dns_group = external
21802026-03-03T18:57:04.601ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 39.436971ms iteration = 2 status = {"addresses":["[::1]:46173"]}
21812026-03-03T18:57:04.601ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 21 38 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 !8..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:38100 req_id = a9e0bb25-a707-4476-96d4-1cdfad9672c8
21822026-03-03T18:57:04.601ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 8504,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:38100 req_id = a9e0bb25-a707-4476-96d4-1cdfad9672c8
21832026-03-03T18:57:04.601ZDEBGtest_metrics (store): query key key = _mgs._tcp
21842026-03-03T18:57:04.601ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
21852026-03-03T18:57:04.601ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:38100 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42517, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = a9e0bb25-a707-4476-96d4-1cdfad9672c8
21862026-03-03T18:57:04.601ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
21872026-03-03T18:57:04.602ZWARNtest_metrics (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal reason = no config
21882026-03-03T18:57:04.602ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 30.93\u{b5}s iteration = 2 status = {"error":"no config"}
21892026-03-03T18:57:04.602ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
21902026-03-03T18:57:04.602ZWARNtest_metrics (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external reason = no config
21912026-03-03T18:57:04.602ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 6.59\u{b5}s iteration = 2 status = {"error":"no config"}
21922026-03-03T18:57:04.602ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42517, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1961, tv_nsec: 866793824 } })
21932026-03-03T18:57:04.602ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
21942026-03-03T18:57:04.602ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 0f 6d 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .m..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:3479 req_id = dfa3b509-df88-4c55-be93-5b8474ac7280
21952026-03-03T18:57:04.602ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 3949,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:3479 req_id = dfa3b509-df88-4c55-be93-5b8474ac7280
21962026-03-03T18:57:04.602ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
21972026-03-03T18:57:04.602ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:3479 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = dfa3b509-df88-4c55-be93-5b8474ac7280
21982026-03-03T18:57:04.611ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
21992026-03-03T18:57:04.611ZTRACtest_metrics (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 00 85 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:21557 req_id = 10db5486-0add-435a-96cc-24ff06fa910b
22002026-03-03T18:57:04.611ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 133,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:21557 req_id = 10db5486-0add-435a-96cc-24ff06fa910b
22012026-03-03T18:57:04.611ZDEBGtest_metrics (store): query key key = _clickhouse-admin-keeper._tcp
22022026-03-03T18:57:04.611ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 133, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal kind = dns peer_addr = [::1]:21557 req_id = 10db5486-0add-435a-96cc-24ff06fa910b
22032026-03-03T18:57:04.612ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal
22042026-03-03T18:57:04.612ZTRACtest_metrics (dns): buffer buffer = Length: 73 (0x49) bytes\n0000: f9 28 01 00 00 01 00 00 00 00 00 01 0a 5f 63 6f .(..........._co\n0010: 63 6b 72 6f 61 63 68 04 5f 74 63 70 0d 63 6f 6e ckroach._tcp.con\n0020: 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 trol-plane.oxide\n0030: 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 .internal..!....\n0040: 29 04 d0 00 00 00 00 00 00 )........ kind = dns peer_addr = [::1]:3636 req_id = 54c3c2fa-4f09-48cd-b64c-276c53dcc564
22052026-03-03T18:57:04.612ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 63784,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_cockroach._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_cockroach._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:3636 req_id = 54c3c2fa-4f09-48cd-b64c-276c53dcc564
22062026-03-03T18:57:04.612ZDEBGtest_metrics (store): query key key = _cockroach._tcp
22072026-03-03T18:57:04.612ZDEBGtest_metrics (store): query key key = 8b178ee8-bb89-4436-88d8-e2f462915df4.host
22082026-03-03T18:57:04.612ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:3636 query = LowerQuery { name: LowerName(Name("_cockroach._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43291, target: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal") }) }] req_id = 54c3c2fa-4f09-48cd-b64c-276c53dcc564
22092026-03-03T18:57:04.612ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43291, target: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1961, tv_nsec: 877323171 } })
22102026-03-03T18:57:04.612ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
22112026-03-03T18:57:04.613ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: ee 08 01 00 00 01 00 00 00 00 00 01 24 38 62 31 ............$8b1\n0010: 37 38 65 65 38 2d 62 62 38 39 2d 34 34 33 36 2d 78ee8-bb89-4436-\n0020: 38 38 64 38 2d 65 32 66 34 36 32 39 31 35 64 66 88d8-e2f462915df\n0030: 34 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 4.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:59034 req_id = 7a72f5d8-9de7-464b-995c-afdd29a054c1
22122026-03-03T18:57:04.615ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 60936,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 56,\n 98,\n 49,\n 55,\n 56,\n 101,\n 101,\n 56,\n 45,\n 98,\n 98,\n 56,\n 57,\n 45,\n 52,\n 52,\n 51,\n 54,\n 45,\n 56,\n 56,\n 100,\n 56,\n 45,\n 101,\n 50,\n 102,\n 52,\n 54,\n 50,\n 57,\n 49,\n 53,\n 100,\n 102,\n 52,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:59034 req_id = 7a72f5d8-9de7-464b-995c-afdd29a054c1
22132026-03-03T18:57:04.615ZDEBGtest_metrics (store): query key key = 8b178ee8-bb89-4436-88d8-e2f462915df4.host
22142026-03-03T18:57:04.615ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:59034 query = LowerQuery { name: LowerName(Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal.")), original: Query { name: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 7a72f5d8-9de7-464b-995c-afdd29a054c1
22152026-03-03T18:57:04.615ZDEBGtest_metrics (BackgroundTasks): begin collection background_task = inventory_collection
22162026-03-03T18:57:04.615ZDEBGtest_metrics (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:42517
22172026-03-03T18:57:04.615ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/ignition
22182026-03-03T18:57:04.615ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22192026-03-03T18:57:04.617ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: a34df21f-b47e-418a-ab97-8a520be16a04, lookup_type: ById(a34df21f-b47e-418a-ab97-8a520be16a04) } result = Ok(())
22202026-03-03T18:57:04.617ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
22212026-03-03T18:57:04.618ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22222026-03-03T18:57:04.618ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
22232026-03-03T18:57:04.618ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22242026-03-03T18:57:04.623ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
22252026-03-03T18:57:04.623ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
22262026-03-03T18:57:04.623ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22272026-03-03T18:57:04.623ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
22282026-03-03T18:57:04.627ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "af006e7e-fedb-41fd-9b46-4d4b995f3e35", "content-length": "835", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22292026-03-03T18:57:04.628ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0
22302026-03-03T18:57:04.629ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe1de67d-9ddf-476f-8698-54e6eb4d6e1c", "content-length": "734", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22312026-03-03T18:57:04.629ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=0
22322026-03-03T18:57:04.633ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "38868d1a-5d1b-4293-bbd3-95e234751c4d", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22332026-03-03T18:57:04.633ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=1
22342026-03-03T18:57:04.634ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8e1662b-6caa-4331-bb30-8059b3b83d97", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22352026-03-03T18:57:04.634ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=0
22362026-03-03T18:57:04.635ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c233da4d-52e9-4e29-b303-7411e05fb220", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22372026-03-03T18:57:04.635ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=1
22382026-03-03T18:57:04.636ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7210a54-3650-458a-9096-7da5ab54cd1e", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22392026-03-03T18:57:04.636ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=0
22402026-03-03T18:57:04.637ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "76d02def-8d76-49ac-8438-993ec20c8196", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22412026-03-03T18:57:04.637ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=1
22422026-03-03T18:57:04.638ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1644f29-8297-4271-ba13-35b764fda062", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22432026-03-03T18:57:04.638ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cmpa
22442026-03-03T18:57:04.638ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2b8dc43-c6ba-4eb2-852d-b30c279a274d", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22452026-03-03T18:57:04.638ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
22462026-03-03T18:57:04.639ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d8cbb65-7c47-4d0b-b20b-ecde46861191", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22472026-03-03T18:57:04.639ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
22482026-03-03T18:57:04.640ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "743b0b1b-4a36-48ef-b7ee-0df0b57c5efb", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22492026-03-03T18:57:04.640ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
22502026-03-03T18:57:04.640ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e6f70e6-3aba-4808-b75e-6b4fb338c358", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22512026-03-03T18:57:04.640ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1
22522026-03-03T18:57:04.641ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bd07257-af06-4a2b-ab7c-d11b6de98b6a", "content-length": "734", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22532026-03-03T18:57:04.641ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=0
22542026-03-03T18:57:04.642ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8132a51-e2e9-40cf-9061-96e2b7cd180d", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22552026-03-03T18:57:04.642ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=1
22562026-03-03T18:57:04.643ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc38c254-b326-4cd7-a253-95644b78a5e9", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22572026-03-03T18:57:04.643ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=0
22582026-03-03T18:57:04.644ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dceea6e4-5d6f-4391-9377-27c8fbf8c048", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22592026-03-03T18:57:04.644ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=1
22602026-03-03T18:57:04.645ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "87416bb2-ac8a-47d8-8fdd-884a96031960", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22612026-03-03T18:57:04.645ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=0
22622026-03-03T18:57:04.647ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "64110430-fe1d-4e5d-862a-eeb2e9a67b85", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22632026-03-03T18:57:04.647ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=1
22642026-03-03T18:57:04.647ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "310cdea6-4d84-4f27-9d2f-56f798f76b3e", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22652026-03-03T18:57:04.647ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cmpa
22662026-03-03T18:57:04.648ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "59e56bb9-5b65-4e1d-b5e8-960f8a7bd294", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22672026-03-03T18:57:04.648ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
22682026-03-03T18:57:04.649ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "28bc0e82-cc95-4e46-89c7-606373efe2cf", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22692026-03-03T18:57:04.652ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
22702026-03-03T18:57:04.653ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bb2a6b3-a45b-4fc6-9cad-677155326bdf", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22712026-03-03T18:57:04.653ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
22722026-03-03T18:57:04.654ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "86264972-81a1-461a-808a-49442ff64742", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22732026-03-03T18:57:04.654ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0
22742026-03-03T18:57:04.655ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "21a4ef0c-8e99-402d-908c-362e3f329e7b", "content-length": "723", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22752026-03-03T18:57:04.655ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/active-slot
22762026-03-03T18:57:04.659ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d858bc5-7c84-45d9-8530-f26e89512017", "content-length": "10", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22772026-03-03T18:57:04.659ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/0
22782026-03-03T18:57:04.660ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a6b0b41-e5d7-4766-b24e-c589e403ab88", "content-length": "144", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22792026-03-03T18:57:04.660ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/1
22802026-03-03T18:57:04.661ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "950f4b14-e316-4f3a-8710-6fdf142035dc", "content-length": "147", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22812026-03-03T18:57:04.661ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=0
22822026-03-03T18:57:04.661ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae496633-2e96-40e2-b997-fa33e4b8824f", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22832026-03-03T18:57:04.662ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=1
22842026-03-03T18:57:04.662ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaa90351-8c2c-48e9-9850-77737ca7f8a8", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22852026-03-03T18:57:04.662ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=0
22862026-03-03T18:57:04.663ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "acfcf69f-b223-44b5-8d7d-447eb3c84a46", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22872026-03-03T18:57:04.663ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=1
22882026-03-03T18:57:04.664ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea1de8b2-f0ab-4b30-badd-eefce2106bce", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22892026-03-03T18:57:04.664ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=0
22902026-03-03T18:57:04.665ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5a13e93-4962-4671-878c-7ba82eb9e671", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22912026-03-03T18:57:04.665ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=1
22922026-03-03T18:57:04.666ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbccfb87-19da-440c-b307-d572c2e57140", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22932026-03-03T18:57:04.666ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cmpa
22942026-03-03T18:57:04.666ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa5caf13-5562-4a28-974a-56e933203ac1", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22952026-03-03T18:57:04.666ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
22962026-03-03T18:57:04.667ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e38cc1e2-3466-4c19-879b-0357e1538b71", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22972026-03-03T18:57:04.667ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
22982026-03-03T18:57:04.668ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "798147ab-6fef-4d4f-af47-dfb87405cd22", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
22992026-03-03T18:57:04.668ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
23002026-03-03T18:57:04.668ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "48ebd28e-887b-4845-932b-b6cc9bff9744", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23012026-03-03T18:57:04.669ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1
23022026-03-03T18:57:04.672ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9ac8591-8e32-4dd5-bc35-f958a5884fb8", "content-length": "723", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23032026-03-03T18:57:04.672ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/active-slot
23042026-03-03T18:57:04.675ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "e17a738d-e1e5-4592-99f1-1e06e9a46c3b", "content-length": "10", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23052026-03-03T18:57:04.675ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/0
23062026-03-03T18:57:04.676ZDEBGtest_metrics (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23072026-03-03T18:57:04.676ZDEBGtest_metrics (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23082026-03-03T18:57:04.676ZDEBGtest_metrics (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23092026-03-03T18:57:04.676ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
23102026-03-03T18:57:04.676ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23112026-03-03T18:57:04.676ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
23122026-03-03T18:57:04.676ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23132026-03-03T18:57:04.677ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23142026-03-03T18:57:04.678ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c1e9213-744e-4d84-9b83-dcb2b100654d", "content-length": "144", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23152026-03-03T18:57:04.678ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/1
23162026-03-03T18:57:04.679ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23172026-03-03T18:57:04.683ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23182026-03-03T18:57:04.683ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
23192026-03-03T18:57:04.683ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23202026-03-03T18:57:04.684ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23212026-03-03T18:57:04.684ZDEBGtest_metrics (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
23222026-03-03T18:57:04.684ZDEBGtest_metrics (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
23232026-03-03T18:57:04.684ZDEBGtest_metrics (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
23242026-03-03T18:57:04.684ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
23252026-03-03T18:57:04.684ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23262026-03-03T18:57:04.684ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
23272026-03-03T18:57:04.684ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23282026-03-03T18:57:04.685ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23292026-03-03T18:57:04.687ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2df2a7eb-6501-45ab-bd6a-71af04b8554f", "content-length": "147", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23302026-03-03T18:57:04.687ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=0
23312026-03-03T18:57:04.688ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet
23322026-03-03T18:57:04.688ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23332026-03-03T18:57:04.688ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
23342026-03-03T18:57:04.688ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23352026-03-03T18:57:04.689ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
23362026-03-03T18:57:04.689ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23372026-03-03T18:57:04.693ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23382026-03-03T18:57:04.693ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
23392026-03-03T18:57:04.693ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23402026-03-03T18:57:04.694ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23412026-03-03T18:57:04.695ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23422026-03-03T18:57:04.698ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23432026-03-03T18:57:04.698ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
23442026-03-03T18:57:04.698ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23452026-03-03T18:57:04.698ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
23462026-03-03T18:57:04.701ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "20003257-8b0e-4aae-8f1e-499e4d362fcf", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23472026-03-03T18:57:04.701ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=1
23482026-03-03T18:57:04.701ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b410e037-34bd-4e61-820f-ac5b3587c8bc", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23492026-03-03T18:57:04.701ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=0
23502026-03-03T18:57:04.701ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0189ae49-6a20-43c1-b7e1-b0add5f89510", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23512026-03-03T18:57:04.701ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=1
23522026-03-03T18:57:04.703ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "57de9aaf-dd1f-4367-89d9-0cef18f8a60c", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23532026-03-03T18:57:04.703ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=0
23542026-03-03T18:57:04.703ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e3c7e3d-c240-455a-b111-d80b6371ab38", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23552026-03-03T18:57:04.703ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=1
23562026-03-03T18:57:04.704ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "eee1abd9-4ff4-4734-8ac5-71757ec3af3d", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23572026-03-03T18:57:04.704ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cmpa
23582026-03-03T18:57:04.705ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "25d3f09b-1acb-4995-9cc5-6621128ed72e", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23592026-03-03T18:57:04.705ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
23602026-03-03T18:57:04.706ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "56bda4fb-37b3-4c6b-9144-52b60f5b3132", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23612026-03-03T18:57:04.706ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
23622026-03-03T18:57:04.706ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "04d7d327-538a-4f17-a1a2-845ab8d6e47b", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23632026-03-03T18:57:04.706ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
23642026-03-03T18:57:04.707ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "85bed8c6-6d5c-4842-89f7-cd2050ecdf0e", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
23652026-03-03T18:57:04.707ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
23662026-03-03T18:57:04.707ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23672026-03-03T18:57:04.707ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
23682026-03-03T18:57:04.707ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23692026-03-03T18:57:04.708ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
23702026-03-03T18:57:04.718ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23712026-03-03T18:57:04.723ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
23722026-03-03T18:57:04.723ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
23732026-03-03T18:57:04.723ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23742026-03-03T18:57:04.723ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
23752026-03-03T18:57:04.723ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23762026-03-03T18:57:04.723ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
23772026-03-03T18:57:04.730ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23782026-03-03T18:57:04.733ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
23792026-03-03T18:57:04.733ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
23802026-03-03T18:57:04.733ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23812026-03-03T18:57:04.733ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
23822026-03-03T18:57:04.739ZINFOtest_metrics (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader target_id = a34df21f-b47e-418a-ab97-8a520be16a04 time_created = 2026-03-03 18:57:03.674671 UTC
23832026-03-03T18:57:04.740ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 173.849027ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"a34df21f-b47e-418a-ab97-8a520be16a04","time_created":"2026-03-03T18:57:03.674671Z","time_found":"2026-03-03T18:57:04.737627745Z"}
23842026-03-03T18:57:04.740ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
23852026-03-03T18:57:04.740ZDEBGtest_metrics (BackgroundTasks): blueprint execution: quiesce check background_task = blueprint_executor quiescing = false
23862026-03-03T18:57:04.740ZINFOtest_metrics (NexusQuiesceHandle): initial state state = Running
23872026-03-03T18:57:04.740ZINFOtest_metrics (SagaQuiesceHandle): initial quiesce state initial_state = Allowed
23882026-03-03T18:57:04.742ZWARNtest_metrics (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor reason = blueprint disabled target_id = a34df21f-b47e-418a-ab97-8a520be16a04
23892026-03-03T18:57:04.742ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 65.43\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"a34df21f-b47e-418a-ab97-8a520be16a04"}
23902026-03-03T18:57:04.742ZDEBGtest_metrics (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
23912026-03-03T18:57:04.742ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet
23922026-03-03T18:57:04.742ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = crdb_node_id_collector resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23932026-03-03T18:57:04.742ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database
23942026-03-03T18:57:04.742ZDEBGtest_metrics (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23952026-03-03T18:57:04.742ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23962026-03-03T18:57:04.757ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 265.222057ms iteration = 2 status = {"Loaded":{"collection_id":"7b82cae1-bfef-49b5-809c-5be3d97f2f81","time_loaded":"2026-03-03T18:57:04.492560498Z","time_started":"2026-03-03T18:57:03.744471Z"}}
23972026-03-03T18:57:04.757ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 3 reason = Dependency
23982026-03-03T18:57:04.757ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
23992026-03-03T18:57:04.757ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 29.28\u{b5}s iteration = 3 status = "Disabled"
24002026-03-03T18:57:04.757ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 4 reason = Dependency
24012026-03-03T18:57:04.757ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
24022026-03-03T18:57:04.757ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 6.03\u{b5}s iteration = 4 status = "Disabled"
24032026-03-03T18:57:04.758ZDEBGtest_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
24042026-03-03T18:57:04.758ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 17.43\u{b5}s iteration = 2 status = {"error":"task disabled"}
24052026-03-03T18:57:04.758ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 2 reason = Dependency
24062026-03-03T18:57:04.758ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
24072026-03-03T18:57:04.758ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
24082026-03-03T18:57:04.758ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
24092026-03-03T18:57:04.758ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 2 reason = Dependency
24102026-03-03T18:57:04.758ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
24112026-03-03T18:57:04.758ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
24122026-03-03T18:57:04.758ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
24132026-03-03T18:57:04.758ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
24142026-03-03T18:57:04.762ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24152026-03-03T18:57:04.768ZDEBGtest_metrics (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:36085
24162026-03-03T18:57:04.768ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = http://[::1]:36085 background_task = inventory_collection body = None method = GET uri = http://[::1]:36085/inventory
24172026-03-03T18:57:04.769ZDEBGtest_metrics (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24182026-03-03T18:57:04.769ZDEBGtest_metrics (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e33a6b53-18d6-4d16-a0f4-aedb212bd1ac dns_zone_name = oxide-dev.test found_so_far = 0 version = 2
24192026-03-03T18:57:04.769ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
24202026-03-03T18:57:04.769ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
24212026-03-03T18:57:04.769ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
24222026-03-03T18:57:04.769ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24232026-03-03T18:57:04.769ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24242026-03-03T18:57:04.770ZDEBGtest_metrics (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24252026-03-03T18:57:04.770ZDEBGtest_metrics (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3146fe31-e02a-46e6-abbc-03fcda68b1aa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24262026-03-03T18:57:04.770ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
24272026-03-03T18:57:04.770ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
24282026-03-03T18:57:04.770ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
24292026-03-03T18:57:04.770ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24302026-03-03T18:57:04.770ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24312026-03-03T18:57:04.771ZINFOtest_metrics (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide-dev.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2026-03-03T18:57:01.197352Z, time_modified: 2026-03-03T18:57:01.197352Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }, "test-suite-silo.sys.oxide-dev.test": ExternalEndpoint { silo_id: a4da2904-e21b-4644-bf7f-b773ce81644d, db_silo: Silo { identity: SiloIdentity { id: a4da2904-e21b-4644-bf7f-b773ce81644d, name: Name(Name("test-suite-silo")), description: "built-in recovery Silo", time_created: 2026-03-03T18:57:04.409214Z, time_modified: 2026-03-03T18:57:04.409214Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide-dev.test" }, NoSiloCerts { silo_id: a4da2904-e21b-4644-bf7f-b773ce81644d, dns_name: "test-suite-silo.sys.oxide-dev.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a4da2904-e21b-4644-bf7f-b773ce81644d, db_silo: Silo { identity: SiloIdentity { id: a4da2904-e21b-4644-bf7f-b773ce81644d, name: Name(Name("test-suite-silo")), description: "built-in recovery Silo", time_created: 2026-03-03T18:57:04.409214Z, time_modified: 2026-03-03T18:57:04.409214Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }) }
24322026-03-03T18:57:04.771ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 209.170521ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide-dev.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"test-suite-silo.sys.oxide-dev.test":{"silo_id":"a4da2904-e21b-4644-bf7f-b773ce81644d","tls_certs":[]}},"default_endpoint":{"silo_id":"a4da2904-e21b-4644-bf7f-b773ce81644d","tls_certs":[]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide-dev.test\\" has no usable certificates","silo a4da2904-e21b-4644-bf7f-b773ce81644d with DNS name \\"test-suite-silo.sys.oxide-dev.test\\" has no usable certificates"]}
24332026-03-03T18:57:04.772ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24342026-03-03T18:57:04.775ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
24352026-03-03T18:57:04.775ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
24362026-03-03T18:57:04.775ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
24372026-03-03T18:57:04.775ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
24382026-03-03T18:57:04.775ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
24392026-03-03T18:57:04.775ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24402026-03-03T18:57:04.776ZTRACtest_metrics (ServiceBalancer): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Database
24412026-03-03T18:57:04.776ZDEBGtest_metrics (ServiceBalancer): roles roles = RoleSet { roles: {} }
24422026-03-03T18:57:04.776ZDEBGtest_metrics (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Database result = Ok(())
24432026-03-03T18:57:04.777ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35808 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
24442026-03-03T18:57:04.778ZDEBGtest_metrics (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24452026-03-03T18:57:04.781ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24462026-03-03T18:57:04.781ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database
24472026-03-03T18:57:04.781ZDEBGtest_metrics (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24482026-03-03T18:57:04.781ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24492026-03-03T18:57:04.782ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24502026-03-03T18:57:04.786ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24512026-03-03T18:57:04.786ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
24522026-03-03T18:57:04.786ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24532026-03-03T18:57:04.786ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24542026-03-03T18:57:04.787ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24552026-03-03T18:57:04.791ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24562026-03-03T18:57:04.791ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
24572026-03-03T18:57:04.791ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24582026-03-03T18:57:04.791ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24592026-03-03T18:57:04.792ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24602026-03-03T18:57:04.795ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
24612026-03-03T18:57:04.795ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
24622026-03-03T18:57:04.795ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
24632026-03-03T18:57:04.795ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24642026-03-03T18:57:04.797ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = GET remote_addr = [::1]:35808 req_id = 47ae41b6-f115-4b03-974b-e4130c1e0149 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
24652026-03-03T18:57:04.798ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = GET remote_addr = [::1]:35808 req_id = 47ae41b6-f115-4b03-974b-e4130c1e0149 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory version = 23.0.0
24662026-03-03T18:57:04.798ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 24 e0 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 $............_de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:7072 req_id = 0899e3c6-5a10-4149-93f1-ad3c6b2c48a4
24672026-03-03T18:57:04.798ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 9440,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:7072 req_id = 0899e3c6-5a10-4149-93f1-ad3c6b2c48a4
24682026-03-03T18:57:04.798ZDEBGtest_metrics (store): query key key = _dendrite._tcp
24692026-03-03T18:57:04.798ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
24702026-03-03T18:57:04.798ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:7072 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 0899e3c6-5a10-4149-93f1-ad3c6b2c48a4
24712026-03-03T18:57:04.803ZINFOtest_metrics (dropshot): request completed latency_us = 2041 local_addr = [::1]:36085 method = GET remote_addr = [::1]:35808 req_id = 47ae41b6-f115-4b03-974b-e4130c1e0149 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
24722026-03-03T18:57:04.804ZDEBGtest_metrics (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e33a6b53-18d6-4d16-a0f4-aedb212bd1ac dns_zone_name = oxide-dev.test found_so_far = 3 version = 2
24732026-03-03T18:57:04.804ZDEBGtest_metrics (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24742026-03-03T18:57:04.805ZINFOtest_metrics (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external generation = 2
24752026-03-03T18:57:04.805ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 238.324266ms iteration = 2 status = {"generation":2}
24762026-03-03T18:57:04.805ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
24772026-03-03T18:57:04.809ZDEBGtest_metrics (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[::1]:46173 generation = 2 method = PUT servers = DnsServersList { addresses: [[::1]:46173] } uri = http://[::1]:46173/config
24782026-03-03T18:57:04.818ZDEBGtest_metrics (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[::1]:32222/node/id
24792026-03-03T18:57:04.822ZDEBGtest_metrics (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3146fe31-e02a-46e6-abbc-03fcda68b1aa dns_zone_name = control-plane.oxide.internal found_so_far = 27 version = 1
24802026-03-03T18:57:04.822ZDEBGtest_metrics (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
24812026-03-03T18:57:04.822ZINFOtest_metrics (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal generation = 1
24822026-03-03T18:57:04.822ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 259.094448ms iteration = 2 status = {"generation":1}
24832026-03-03T18:57:04.822ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
24842026-03-03T18:57:04.828ZDEBGtest_metrics (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[::1]:34487 generation = 1 method = PUT servers = DnsServersList { addresses: [[::1]:34487] } uri = http://[::1]:34487/config
24852026-03-03T18:57:04.828ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
24862026-03-03T18:57:04.828ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
24872026-03-03T18:57:04.828ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
24882026-03-03T18:57:04.828ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
24892026-03-03T18:57:04.829ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24902026-03-03T18:57:04.830ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1962, tv_nsec: 94691325 } })
24912026-03-03T18:57:04.830ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
24922026-03-03T18:57:04.830ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:46173 remote_addr = [::1]:45200
24932026-03-03T18:57:04.830ZDEBGtest_metrics (BackgroundTasks): client response background_task = crdb_node_id_collector result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
24942026-03-03T18:57:04.830ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 93.028343ms iteration = 2 status = {"errors":[{"err":"failed to fetch node ID for zone 8b178ee8-bb89-4436-88d8-e2f462915df4 at http://[::1]:32222: Communication Error: error sending request for url (http://[::1]:32222/node/id): error sending request for url (http://[::1]:32222/node/id): client error (Connect): tcp connect error: Connection refused (os error 111)","zone_id":"8b178ee8-bb89-4436-88d8-e2f462915df4"}],"nsuccess":0}
24952026-03-03T18:57:04.830ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:34487 remote_addr = [::1]:39240
24962026-03-03T18:57:04.831ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = http://[::1]:36085 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:36085/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "47ae41b6-f115-4b03-974b-e4130c1e0149", "content-length": "20607", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
24972026-03-03T18:57:04.832ZDEBGtest_metrics (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
24982026-03-03T18:57:04.832ZDEBGtest_metrics (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
24992026-03-03T18:57:04.832ZDEBGtest_metrics (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
25002026-03-03T18:57:04.832ZDEBGtest_metrics (CockroachClusterAdminClient): client request body = None method = GET uri = http://[::1]:32222/node/id
25012026-03-03T18:57:04.833ZTRACtest_metrics (ServiceBalancer): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
25022026-03-03T18:57:04.833ZTRACtest_metrics (ServiceBalancer): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
25032026-03-03T18:57:04.833ZTRACtest_metrics (ServiceBalancer): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Database
25042026-03-03T18:57:04.833ZDEBGtest_metrics (ServiceBalancer): roles roles = RoleSet { roles: {} }
25052026-03-03T18:57:04.833ZDEBGtest_metrics (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Database result = Ok(())
25062026-03-03T18:57:04.834ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:46173 method = PUT remote_addr = [::1]:45200 req_id = b3a0658e-416b-4642-90e1-08f2df708184 uri = /config
25072026-03-03T18:57:04.834ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:46173 method = PUT remote_addr = [::1]:45200 req_id = b3a0658e-416b-4642-90e1-08f2df708184 uri = /config version = 2.0.0
25082026-03-03T18:57:04.834ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:34487 method = PUT remote_addr = [::1]:39240 req_id = 74976edb-3323-49ad-944c-acb45caef1fc uri = /config
25092026-03-03T18:57:04.834ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:34487 method = PUT remote_addr = [::1]:39240 req_id = 74976edb-3323-49ad-944c-acb45caef1fc uri = /config version = 2.0.0
25102026-03-03T18:57:04.834ZDEBGtest_metrics (CockroachClusterAdminClient): client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
25112026-03-03T18:57:04.834ZINFOtest_metrics (store): attempting generation update new_generation = 2 req_id = b3a0658e-416b-4642-90e1-08f2df708184
25122026-03-03T18:57:04.834ZINFOtest_metrics (store): pruning trees for generations newer than 0
25132026-03-03T18:57:04.834ZDEBGtest_metrics (store): creating tree tree_name = generation_2_zone_oxide-dev.test
25142026-03-03T18:57:04.835ZINFOtest_metrics (store): attempting generation update new_generation = 1 req_id = 74976edb-3323-49ad-944c-acb45caef1fc
25152026-03-03T18:57:04.835ZINFOtest_metrics (store): updated generation new_generation = 1 req_id = 74976edb-3323-49ad-944c-acb45caef1fc
25162026-03-03T18:57:04.835ZWARNtest_metrics (CockroachClusterAdminClient): Failed to fetch metrics from CockroachDB node error = Failed to get node ID from [::1]:32222
25172026-03-03T18:57:04.843ZDEBGtest_metrics (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[::1]:10123 zone_id = 128cd5ee-2d78-44f6-9fb4-83dda8b3d1a4 (omicron_zone)
25182026-03-03T18:57:04.844ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[::1]:10123 uri = http://[::1]:10123/timesync
25192026-03-03T18:57:04.844ZINFOtest_metrics (http): request completed kind = dns latency_us = 9953 local_addr = [::1]:34487 method = PUT remote_addr = [::1]:39240 req_id = 74976edb-3323-49ad-944c-acb45caef1fc response_code = 204 uri = /config
25202026-03-03T18:57:04.844ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25212026-03-03T18:57:04.847ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
25222026-03-03T18:57:04.847ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
25232026-03-03T18:57:04.847ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
25242026-03-03T18:57:04.847ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
25252026-03-03T18:57:04.847ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25262026-03-03T18:57:04.847ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25272026-03-03T18:57:04.848ZDEBGtest_metrics (store): updating current config
25282026-03-03T18:57:04.849ZDEBGtest_metrics (store): flushing default tree
25292026-03-03T18:57:04.849ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[::1]:10123 result = Err(reqwest::Error { kind: Request, url: "http://[::1]:10123/timesync", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:10123, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
25302026-03-03T18:57:04.849ZDEBGtest_metrics (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
25312026-03-03T18:57:04.858ZDEBGtest_metrics (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 2a83ee47-a98f-4924-a414-6bdba496b84f (omicron_zone)
25322026-03-03T18:57:04.858ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[::1]:34487 method = GET uri = http://[::1]:34487/config
25332026-03-03T18:57:04.858ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 54 65 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e Te..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:9516 req_id = 9ea9e181-63f4-45c6-9400-b72409761902
25342026-03-03T18:57:04.858ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 21605,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:9516 req_id = 9ea9e181-63f4-45c6-9400-b72409761902
25352026-03-03T18:57:04.858ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
25362026-03-03T18:57:04.858ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:9516 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 9ea9e181-63f4-45c6-9400-b72409761902
25372026-03-03T18:57:04.859ZDEBGtest_metrics (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[::1]:34487 generation = 1 result = Ok(Response { url: "http://[::1]:34487/config", status: 204, headers: {"x-request-id": "74976edb-3323-49ad-944c-acb45caef1fc", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} }) servers = DnsServersList { addresses: [[::1]:34487] }
25382026-03-03T18:57:04.859ZINFOtest_metrics (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[::1]:34487 generation = 1 servers = DnsServersList { addresses: [[::1]:34487] }
25392026-03-03T18:57:04.859ZINFOtest_metrics (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal generation = 1 servers = DnsServersList { addresses: [[::1]:34487] }
25402026-03-03T18:57:04.859ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 40.520152ms iteration = 3 status = {"generation":1,"server_results":{"[::1]:34487":{"Ok":null}}}
25412026-03-03T18:57:04.859ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25422026-03-03T18:57:04.862ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
25432026-03-03T18:57:04.862ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
25442026-03-03T18:57:04.862ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25452026-03-03T18:57:04.862ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25462026-03-03T18:57:04.864ZINFOtest_metrics (store): pruning trees for generations older than 2 keep = 3
25472026-03-03T18:57:04.864ZINFOtest_metrics (store): updated generation new_generation = 2 req_id = b3a0658e-416b-4642-90e1-08f2df708184
25482026-03-03T18:57:04.864ZINFOtest_metrics (http): request completed kind = dns latency_us = 29260 local_addr = [::1]:46173 method = PUT remote_addr = [::1]:45200 req_id = b3a0658e-416b-4642-90e1-08f2df708184 response_code = 204 uri = /config
25492026-03-03T18:57:04.864ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:34487 remote_addr = [::1]:39242
25502026-03-03T18:57:04.883ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:34679/switch/identifiers
25512026-03-03T18:57:04.883ZDEBGtest_metrics (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[::1]:46173 generation = 2 result = Ok(Response { url: "http://[::1]:46173/config", status: 204, headers: {"x-request-id": "b3a0658e-416b-4642-90e1-08f2df708184", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} }) servers = DnsServersList { addresses: [[::1]:46173] }
25522026-03-03T18:57:04.883ZINFOtest_metrics (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[::1]:46173 generation = 2 servers = DnsServersList { addresses: [[::1]:46173] }
25532026-03-03T18:57:04.883ZINFOtest_metrics (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external generation = 2 servers = DnsServersList { addresses: [[::1]:46173] }
25542026-03-03T18:57:04.883ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 84.41589ms iteration = 3 status = {"generation":2,"server_results":{"[::1]:46173":{"Ok":null}}}
25552026-03-03T18:57:04.885ZDEBGtest_metrics (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25562026-03-03T18:57:04.894ZDEBGtest_metrics (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
25572026-03-03T18:57:04.895ZINFOtest_metrics (nexus): Rack initialized
25582026-03-03T18:57:04.895ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
25592026-03-03T18:57:04.895ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
25602026-03-03T18:57:04.895ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
25612026-03-03T18:57:04.895ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:34487 method = GET remote_addr = [::1]:39242 req_id = 0de6985c-0cb9-4da6-8515-686c2c65016c uri = /config
25622026-03-03T18:57:04.895ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:34487 method = GET remote_addr = [::1]:39242 req_id = 0de6985c-0cb9-4da6-8515-686c2c65016c uri = /config version = 2.0.0
25632026-03-03T18:57:04.897ZINFOtest_metrics (http): request completed kind = dns latency_us = 994 local_addr = [::1]:34487 method = GET remote_addr = [::1]:39242 req_id = 0de6985c-0cb9-4da6-8515-686c2c65016c response_code = 200 uri = /config
25642026-03-03T18:57:04.898ZINFOtest_metrics (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous num_already_exist = 0 num_inserted = 0 num_not_in_inventory = 0
25652026-03-03T18:57:04.898ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
25662026-03-03T18:57:04.898ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
25672026-03-03T18:57:04.898ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
25682026-03-03T18:57:04.898ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25692026-03-03T18:57:04.898ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25702026-03-03T18:57:04.899ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[::1]:34487 result = Ok(Response { url: "http://[::1]:34487/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0de6985c-0cb9-4da6-8515-686c2c65016c", "content-length": "3478", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
25712026-03-03T18:57:04.899ZDEBGtest_metrics (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 2a83ee47-a98f-4924-a414-6bdba496b84f (omicron_zone)
25722026-03-03T18:57:04.900ZDEBGtest_metrics (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
25732026-03-03T18:57:04.900ZDEBGtest_metrics (BackgroundTasks): finished collection background_task = inventory_collection
25742026-03-03T18:57:04.900ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
25752026-03-03T18:57:04.900ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
25762026-03-03T18:57:04.900ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
25772026-03-03T18:57:04.900ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
25782026-03-03T18:57:04.900ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
25792026-03-03T18:57:04.901ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:34679/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0260b19-b852-422a-aa6d-3573318f2dcd", "content-length": "206", "date": "Tue, 03 Mar 2026 18:57:04 GMT"} })
25802026-03-03T18:57:04.901ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
25812026-03-03T18:57:04.901ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
25822026-03-03T18:57:04.901ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
25832026-03-03T18:57:04.901ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
25842026-03-03T18:57:04.903ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25852026-03-03T18:57:04.906ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
25862026-03-03T18:57:04.906ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
25872026-03-03T18:57:04.906ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
25882026-03-03T18:57:04.906ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
25892026-03-03T18:57:04.906ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25902026-03-03T18:57:04.906ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25912026-03-03T18:57:04.907ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25922026-03-03T18:57:04.910ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
25932026-03-03T18:57:04.911ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
25942026-03-03T18:57:04.911ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
25952026-03-03T18:57:04.916ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
25962026-03-03T18:57:04.940ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25972026-03-03T18:57:04.943ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
25982026-03-03T18:57:04.943ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
25992026-03-03T18:57:04.943ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
26002026-03-03T18:57:04.943ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
26012026-03-03T18:57:04.944ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26022026-03-03T18:57:04.944ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26032026-03-03T18:57:04.945ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26042026-03-03T18:57:04.961ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26052026-03-03T18:57:04.961ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26062026-03-03T18:57:04.962ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26072026-03-03T18:57:04.965ZINFOtest_metrics (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
26082026-03-03T18:57:04.970ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
26092026-03-03T18:57:04.970ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
26102026-03-03T18:57:04.970ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
26112026-03-03T18:57:04.970ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
26122026-03-03T18:57:04.970ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
26132026-03-03T18:57:04.973ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
26142026-03-03T18:57:04.973ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
26152026-03-03T18:57:04.973ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26162026-03-03T18:57:04.973ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26172026-03-03T18:57:04.973ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26182026-03-03T18:57:04.976ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
26192026-03-03T18:57:04.976ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26202026-03-03T18:57:04.976ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26212026-03-03T18:57:04.977ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26222026-03-03T18:57:04.977ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26232026-03-03T18:57:04.980ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
26242026-03-03T18:57:04.980ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
26252026-03-03T18:57:04.980ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
26262026-03-03T18:57:04.980ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
26272026-03-03T18:57:04.980ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
26282026-03-03T18:57:04.980ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
26292026-03-03T18:57:04.981ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
26302026-03-03T18:57:04.981ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
26312026-03-03T18:57:04.981ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
26322026-03-03T18:57:04.981ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
26332026-03-03T18:57:04.981ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
26342026-03-03T18:57:04.983ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
26352026-03-03T18:57:04.983ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26362026-03-03T18:57:04.983ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26372026-03-03T18:57:04.984ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26382026-03-03T18:57:04.986ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26392026-03-03T18:57:04.999ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
26402026-03-03T18:57:04.999ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
26412026-03-03T18:57:04.999ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
26422026-03-03T18:57:05.006ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
26432026-03-03T18:57:05.014ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26442026-03-03T18:57:05.055ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
26452026-03-03T18:57:05.055ZTRACtest_metrics (InternalApi): successful lookup of siloed resource "Vpc" using built-in user
26462026-03-03T18:57:05.055ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
26472026-03-03T18:57:05.055ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
26482026-03-03T18:57:05.055ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26492026-03-03T18:57:05.055ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26502026-03-03T18:57:05.056ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26512026-03-03T18:57:05.064ZINFOtest_metrics (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
26522026-03-03T18:57:05.064ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 306.04182ms iteration = 2 status = {"blueprint_id":"a34df21f-b47e-418a-ab97-8a520be16a04","inventory_collection_id":"7b82cae1-bfef-49b5-809c-5be3d97f2f81","stats":{"crucible_dataset":{"num_already_exist":0,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
26532026-03-03T18:57:05.066ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
26542026-03-03T18:57:05.066ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26552026-03-03T18:57:05.066ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26562026-03-03T18:57:05.066ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26572026-03-03T18:57:05.067ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
26582026-03-03T18:57:05.067ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
26592026-03-03T18:57:05.067ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
26602026-03-03T18:57:05.067ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
26612026-03-03T18:57:05.068ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
26622026-03-03T18:57:05.081ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
26632026-03-03T18:57:05.081ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26642026-03-03T18:57:05.081ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26652026-03-03T18:57:05.081ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26662026-03-03T18:57:05.085ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26672026-03-03T18:57:05.091ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
26682026-03-03T18:57:05.092ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26692026-03-03T18:57:05.092ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26702026-03-03T18:57:05.092ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26712026-03-03T18:57:05.095ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26722026-03-03T18:57:05.095ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26732026-03-03T18:57:05.096ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26742026-03-03T18:57:05.097ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
26752026-03-03T18:57:05.097ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
26762026-03-03T18:57:05.098ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
26772026-03-03T18:57:05.098ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
26782026-03-03T18:57:05.098ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
26792026-03-03T18:57:05.104ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26802026-03-03T18:57:05.104ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26812026-03-03T18:57:05.104ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26822026-03-03T18:57:05.105ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
26832026-03-03T18:57:05.105ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
26842026-03-03T18:57:05.105ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
26852026-03-03T18:57:05.105ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
26862026-03-03T18:57:05.108ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26872026-03-03T18:57:05.108ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26882026-03-03T18:57:05.109ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26892026-03-03T18:57:05.110ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
26902026-03-03T18:57:05.110ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
26912026-03-03T18:57:05.110ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26922026-03-03T18:57:05.110ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26932026-03-03T18:57:05.111ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26942026-03-03T18:57:05.112ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
26952026-03-03T18:57:05.113ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26962026-03-03T18:57:05.113ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26972026-03-03T18:57:05.113ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26982026-03-03T18:57:05.115ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
26992026-03-03T18:57:05.115ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27002026-03-03T18:57:05.115ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27012026-03-03T18:57:05.115ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27022026-03-03T18:57:05.123ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27032026-03-03T18:57:05.129ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
27042026-03-03T18:57:05.129ZTRACtest_metrics (InternalApi): successful lookup of siloed resource "Vpc" using built-in user
27052026-03-03T18:57:05.129ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27062026-03-03T18:57:05.129ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27072026-03-03T18:57:05.129ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27082026-03-03T18:57:05.131ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27092026-03-03T18:57:05.131ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27102026-03-03T18:57:05.132ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27112026-03-03T18:57:05.133ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27122026-03-03T18:57:05.133ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27132026-03-03T18:57:05.134ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27142026-03-03T18:57:05.135ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27152026-03-03T18:57:05.135ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27162026-03-03T18:57:05.135ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27172026-03-03T18:57:05.140ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
27182026-03-03T18:57:05.141ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
27192026-03-03T18:57:05.141ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
27202026-03-03T18:57:05.141ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
27212026-03-03T18:57:05.141ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
27222026-03-03T18:57:05.164ZTRACtest_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
27232026-03-03T18:57:05.164ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
27242026-03-03T18:57:05.164ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27252026-03-03T18:57:05.164ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27262026-03-03T18:57:05.165ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27272026-03-03T18:57:05.173ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
27282026-03-03T18:57:05.173ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27292026-03-03T18:57:05.174ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27302026-03-03T18:57:05.174ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27312026-03-03T18:57:05.179ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
27322026-03-03T18:57:05.179ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27332026-03-03T18:57:05.179ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27342026-03-03T18:57:05.180ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27352026-03-03T18:57:05.182ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27362026-03-03T18:57:05.189ZDEBGtest_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
27372026-03-03T18:57:05.189ZTRACtest_metrics (InternalApi): successful lookup of siloed resource "VpcSubnet" using built-in user
27382026-03-03T18:57:05.189ZTRACtest_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
27392026-03-03T18:57:05.189ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
27402026-03-03T18:57:05.189ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27412026-03-03T18:57:05.189ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27422026-03-03T18:57:05.189ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27432026-03-03T18:57:05.192ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
27442026-03-03T18:57:05.192ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27452026-03-03T18:57:05.192ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27462026-03-03T18:57:05.192ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27472026-03-03T18:57:05.197ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
27482026-03-03T18:57:05.197ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27492026-03-03T18:57:05.197ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27502026-03-03T18:57:05.197ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27512026-03-03T18:57:05.198ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
27522026-03-03T18:57:05.198ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
27532026-03-03T18:57:05.199ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
27542026-03-03T18:57:05.199ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 441.886408ms iteration = 2 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
27552026-03-03T18:57:05.204ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27562026-03-03T18:57:05.212ZDEBGtest_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
27572026-03-03T18:57:05.212ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27582026-03-03T18:57:05.212ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27592026-03-03T18:57:05.213ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27602026-03-03T18:57:05.227ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27612026-03-03T18:57:05.227ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27622026-03-03T18:57:05.228ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27632026-03-03T18:57:05.233ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27642026-03-03T18:57:05.233ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27652026-03-03T18:57:05.234ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27662026-03-03T18:57:05.236ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27672026-03-03T18:57:05.236ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27682026-03-03T18:57:05.236ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27692026-03-03T18:57:05.238ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27702026-03-03T18:57:05.240ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27712026-03-03T18:57:05.240ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27722026-03-03T18:57:05.240ZTRACtest_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
27732026-03-03T18:57:05.240ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
27742026-03-03T18:57:05.240ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27752026-03-03T18:57:05.240ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27762026-03-03T18:57:05.241ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27772026-03-03T18:57:05.242ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
27782026-03-03T18:57:05.242ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27792026-03-03T18:57:05.242ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27802026-03-03T18:57:05.243ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27812026-03-03T18:57:05.247ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
27822026-03-03T18:57:05.247ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27832026-03-03T18:57:05.247ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27842026-03-03T18:57:05.248ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27852026-03-03T18:57:05.252ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27862026-03-03T18:57:05.258ZDEBGtest_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
27872026-03-03T18:57:05.258ZTRACtest_metrics (InternalApi): successful lookup of siloed resource "VpcSubnet" using built-in user
27882026-03-03T18:57:05.258ZTRACtest_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
27892026-03-03T18:57:05.258ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
27902026-03-03T18:57:05.258ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27912026-03-03T18:57:05.259ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27922026-03-03T18:57:05.259ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27932026-03-03T18:57:05.263ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
27942026-03-03T18:57:05.264ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27952026-03-03T18:57:05.266ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27962026-03-03T18:57:05.266ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27972026-03-03T18:57:05.266ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
27982026-03-03T18:57:05.266ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27992026-03-03T18:57:05.266ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
28002026-03-03T18:57:05.267ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
28012026-03-03T18:57:05.273ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28022026-03-03T18:57:05.280ZDEBGtest_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
28032026-03-03T18:57:05.281ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
28042026-03-03T18:57:05.281ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
28052026-03-03T18:57:05.281ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
28062026-03-03T18:57:05.290ZDEBGtest_metrics (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 53ff44a0-2d3e-4556-9a5d-815fb3416e86, kind: Service { id: 913233fe-92a8-4635-9572-183f495429c4 }, name: Name("nexus-913233fe-92a8-4635-9572-183f495429c4"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 1])), vni: Vni(100), primary: true, slot: 0 }], Name("external-dns"): [NetworkInterface { id: 5dd068fd-0eb8-4239-80c3-3a6010ad0b2b, kind: Service { id: a0b447ac-c7a0-4310-8017-829376663066 }, name: Name("external-dns-a0b447ac-c7a0-4310-8017-829376663066"), ip_config: V6(PrivateIpv6Config { ip: fd77:e9d2:9cd9:1::6, subnet: Ipv6Net { addr: fd77:e9d2:9cd9:1::, width: 64 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 0])), vni: Vni(100), primary: true, slot: 0 }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
28072026-03-03T18:57:05.290ZTRACtest_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
28082026-03-03T18:57:05.290ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
28092026-03-03T18:57:05.290ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
28102026-03-03T18:57:05.290ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
28112026-03-03T18:57:05.290ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
28122026-03-03T18:57:05.291ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28132026-03-03T18:57:05.294ZDEBGtest_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
28142026-03-03T18:57:05.296ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
28152026-03-03T18:57:05.296ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
28162026-03-03T18:57:05.296ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
28172026-03-03T18:57:05.298ZTRACtest_metrics (InternalApi): fetched allowlist from DB allowed = AllowList { id: 001de000-a110-4000-8000-000000000000, time_created: 2026-03-03T18:36:54.041040Z, time_modified: 2026-03-03T18:57:04.515669Z, allowed_ips: None }
28182026-03-03T18:57:05.298ZDEBGtest_metrics (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
28192026-03-03T18:57:05.298ZDEBGtest_metrics (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5dd068fd-0eb8-4239-80c3-3a6010ad0b2b, kind: Service { id: a0b447ac-c7a0-4310-8017-829376663066 }, name: Name("external-dns-a0b447ac-c7a0-4310-8017-829376663066"), ip_config: V6(PrivateIpv6Config { ip: fd77:e9d2:9cd9:1::6, subnet: Ipv6Net { addr: fd77:e9d2:9cd9:1::, width: 64 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 0])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 53ff44a0-2d3e-4556-9a5d-815fb3416e86, kind: Service { id: 913233fe-92a8-4635-9572-183f495429c4 }, name: Name("nexus-913233fe-92a8-4635-9572-183f495429c4"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 1])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 5dd068fd-0eb8-4239-80c3-3a6010ad0b2b, kind: Service { id: a0b447ac-c7a0-4310-8017-829376663066 }, name: Name("external-dns-a0b447ac-c7a0-4310-8017-829376663066"), ip_config: V6(PrivateIpv6Config { ip: fd77:e9d2:9cd9:1::6, subnet: Ipv6Net { addr: fd77:e9d2:9cd9:1::, width: 64 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 0])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 53ff44a0-2d3e-4556-9a5d-815fb3416e86, kind: Service { id: 913233fe-92a8-4635-9572-183f495429c4 }, name: Name("nexus-913233fe-92a8-4635-9572-183f495429c4"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 1])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
28202026-03-03T18:57:05.298ZDEBGtest_metrics (InternalApi): resolved 3 rules for sleds
28212026-03-03T18:57:05.314ZDEBGtest_metrics (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: b6d65341-167c-41df-9b5c-41cded99c229 (sled), time_created: 2026-03-03T18:57:02.399933Z, time_modified: 2026-03-03T18:57:02.399933Z }, time_deleted: None, rcgen: Generation(Generation(1)), rack_id: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, is_scrimlet: true, serial_number: "SimGimlet00", part_number: "i86pc", revision: SqlU32(3), usable_hardware_threads: SqlU32(16), usable_physical_ram: ByteCount(ByteCount(34359738368)), reservoir_size: ByteCount(ByteCount(17179869184)), ip: ::1, port: SqlU16(36085), last_used_address: ::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(42957), cpu_family: AmdMilan }]
28222026-03-03T18:57:05.314ZDEBGtest_metrics (InternalApi): sending firewall rules to sled agents
28232026-03-03T18:57:05.322ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
28242026-03-03T18:57:05.322ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
28252026-03-03T18:57:05.323ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
28262026-03-03T18:57:05.326ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
28272026-03-03T18:57:05.326ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
28282026-03-03T18:57:05.326ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
28292026-03-03T18:57:05.326ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
28302026-03-03T18:57:05.326ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
28312026-03-03T18:57:05.327ZINFOtest_metrics (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 7b3e1531-9e16-46a8-b395-70c01b6466c5
28322026-03-03T18:57:05.327ZDEBGtest_metrics (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 7b3e1531-9e16-46a8-b395-70c01b6466c5 time_started = 2026-03-03 18:57:04.613229 UTC
28332026-03-03T18:57:05.327ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 764.466814ms iteration = 3 status = {"collection_id":"7b3e1531-9e16-46a8-b395-70c01b6466c5","time_done":"2026-03-03 18:57:04.900046 UTC","time_started":"2026-03-03 18:57:04.613229 UTC"}
28342026-03-03T18:57:05.327ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 3 reason = Dependency
28352026-03-03T18:57:05.327ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
28362026-03-03T18:57:05.327ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
28372026-03-03T18:57:05.327ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
28382026-03-03T18:57:05.327ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
28392026-03-03T18:57:05.328ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
28402026-03-03T18:57:05.329ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28412026-03-03T18:57:05.333ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
28422026-03-03T18:57:05.333ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
28432026-03-03T18:57:05.333ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
28442026-03-03T18:57:05.333ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
28452026-03-03T18:57:05.334ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28462026-03-03T18:57:05.338ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
28472026-03-03T18:57:05.338ZDEBGtest_metrics (InternalApi): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 body = Some(Body) method = PUT uri = http://[::1]:36085/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28482026-03-03T18:57:05.338ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35810 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
28492026-03-03T18:57:05.340ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35810 req_id = 683f3847-9c5b-4efa-b078-cb146299c31d sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28502026-03-03T18:57:05.340ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35810 req_id = 683f3847-9c5b-4efa-b078-cb146299c31d sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules version = 23.0.0
28512026-03-03T18:57:05.340ZINFOtest_metrics (dropshot): request completed latency_us = 744 local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35810 req_id = 683f3847-9c5b-4efa-b078-cb146299c31d response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28522026-03-03T18:57:05.340ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
28532026-03-03T18:57:05.340ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
28542026-03-03T18:57:05.340ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
28552026-03-03T18:57:05.340ZDEBGtest_metrics (InternalApi): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 result = Ok(Response { url: "http://[::1]:36085/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "683f3847-9c5b-4efa-b078-cb146299c31d", "date": "Tue, 03 Mar 2026 18:57:05 GMT"} })
28562026-03-03T18:57:05.341ZINFOtest_metrics (InternalApi): updated firewall rules on 1 sleds
28572026-03-03T18:57:05.341ZINFOtest_metrics (nexus): plumbed initial IP allowlist
28582026-03-03T18:57:05.361ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = / versions = all
28592026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /access versions = all
28602026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /assets/{path} versions = all
28612026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /device/auth versions = all
28622026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /device/confirm versions = all
28632026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /device/success versions = all
28642026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /device/token versions = all
28652026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /device/verify versions = all
28662026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /experimental/v1/probes versions = all starting from 2026010300.0.0
28672026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /experimental/v1/probes versions = all ending with 2026010300.0.0
28682026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /experimental/v1/probes versions = all starting from 2026010500.0.0
28692026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /experimental/v1/probes versions = all ending with 2026010500.0.0
28702026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /experimental/v1/probes/{probe} versions = all
28712026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /experimental/v1/probes/{probe} versions = all starting from 2026010300.0.0
28722026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /experimental/v1/probes/{probe} versions = all ending with 2026010300.0.0
28732026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /experimental/v1/system/support-bundles versions = all
28742026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /experimental/v1/system/support-bundles versions = all
28752026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
28762026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
28772026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
28782026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
28792026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
28802026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
28812026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
28822026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/index versions = all
28832026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /images versions = all
28842026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /login versions = all
28852026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /login/{silo_name}/local versions = all
28862026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
28872026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
28882026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
28892026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /lookup/{path} versions = all
28902026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /projects/{path} versions = all
28912026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /projects-new versions = all
28922026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /scim/v2/Groups versions = all
28932026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /scim/v2/Groups versions = all
28942026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /scim/v2/Groups/{group_id} versions = all
28952026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /scim/v2/Groups/{group_id} versions = all
28962026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PATCH path = /scim/v2/Groups/{group_id} versions = all
28972026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /scim/v2/Groups/{group_id} versions = all
28982026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /scim/v2/Users versions = all
28992026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /scim/v2/Users versions = all
29002026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /scim/v2/Users/{user_id} versions = all
29012026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /scim/v2/Users/{user_id} versions = all
29022026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PATCH path = /scim/v2/Users/{user_id} versions = all
29032026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /scim/v2/Users/{user_id} versions = all
29042026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /settings/{path} versions = all
29052026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /system/{path} versions = all
29062026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /utilization versions = all
29072026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/affinity-groups versions = all
29082026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/affinity-groups versions = all
29092026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
29102026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
29112026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
29122026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
29132026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
29142026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
29152026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
29162026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/alert-classes versions = all
29172026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/alert-receivers versions = all
29182026-03-03T18:57:05.362ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/alert-receivers/{receiver} versions = all
29192026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/alert-receivers/{receiver} versions = all
29202026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/alert-receivers/{receiver}/deliveries versions = all
29212026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/alert-receivers/{receiver}/probe versions = all
29222026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/alert-receivers/{receiver}/subscriptions versions = all
29232026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/alert-receivers/{receiver}/subscriptions/{subscription} versions = all
29242026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/alerts/{alert_id}/resend versions = all
29252026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/anti-affinity-groups versions = all
29262026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/anti-affinity-groups versions = all
29272026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
29282026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
29292026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
29302026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
29312026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
29322026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
29332026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
29342026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/auth-settings versions = all
29352026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/auth-settings versions = all
29362026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/certificates versions = all
29372026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/certificates versions = all
29382026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/certificates/{certificate} versions = all
29392026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/certificates/{certificate} versions = all
29402026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/disks versions = all starting from 2026013001.0.0
29412026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/disks versions = from 2025120300.0.0 to 2026013001.0.0
29422026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/disks versions = all ending with 2025120300.0.0
29432026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/disks versions = all starting from 2026013100.0.0
29442026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/disks versions = from 2026013001.0.0 to 2026013100.0.0
29452026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/disks versions = from 2025120300.0.0 to 2026013001.0.0
29462026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/disks versions = all ending with 2025120300.0.0
29472026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/disks/{disk} versions = all
29482026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/disks/{disk} versions = all starting from 2026013001.0.0
29492026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/disks/{disk} versions = from 2025120300.0.0 to 2026013001.0.0
29502026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/disks/{disk} versions = all ending with 2025120300.0.0
29512026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/disks/{disk}/bulk-write versions = all
29522026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
29532026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
29542026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/disks/{disk}/finalize versions = all
29552026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/external-subnets versions = all starting from 2026011601.0.0
29562026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/external-subnets versions = all starting from 2026012201.0.0
29572026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/external-subnets versions = from 2026011601.0.0 to 2026012201.0.0
29582026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
29592026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
29602026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
29612026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/external-subnets/{external_subnet}/attach versions = all starting from 2026011601.0.0
29622026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/external-subnets/{external_subnet}/detach versions = all starting from 2026011601.0.0
29632026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/floating-ips versions = all
29642026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/floating-ips versions = all starting from 2026012200.0.0
29652026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/floating-ips versions = from 2026011600.0.0 to 2026012200.0.0
29662026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/floating-ips versions = from 2026010500.0.0 to 2026011600.0.0
29672026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/floating-ips versions = from 2025122300.0.0 to 2026010500.0.0
29682026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/floating-ips versions = all ending with 2025122300.0.0
29692026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
29702026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/floating-ips/{floating_ip} versions = all
29712026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
29722026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
29732026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
29742026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/groups versions = all
29752026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/groups/{group_id} versions = all
29762026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/images versions = all
29772026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/images versions = all
29782026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/images/{image} versions = all
29792026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/images/{image} versions = all
29802026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/images/{image}/demote versions = all
29812026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/images/{image}/promote versions = all
29822026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances versions = all
29832026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances versions = all starting from 2026013100.0.0
29842026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances versions = from 2026013001.0.0 to 2026013100.0.0
29852026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances versions = from 2026010800.0.0 to 2026013001.0.0
29862026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances versions = from 2026010500.0.0 to 2026010800.0.0
29872026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances versions = from 2026010300.0.0 to 2026010500.0.0
29882026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances versions = from 2025122300.0.0 to 2026010300.0.0
29892026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances versions = from 2025120300.0.0 to 2025122300.0.0
29902026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances versions = all ending with 2025120300.0.0
29912026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/instances/{instance} versions = all
29922026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances/{instance} versions = all
29932026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/instances/{instance} versions = all starting from 2026010800.0.0
29942026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/instances/{instance} versions = all ending with 2026010800.0.0
29952026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances/{instance}/affinity-groups versions = all
29962026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances/{instance}/anti-affinity-groups versions = all
29972026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances/{instance}/disks versions = all starting from 2026013001.0.0
29982026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances/{instance}/disks versions = from 2025120300.0.0 to 2026013001.0.0
29992026-03-03T18:57:05.363ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances/{instance}/disks versions = all ending with 2025120300.0.0
30002026-03-03T18:57:05.364ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances/{instance}/disks/attach versions = all starting from 2026013001.0.0
30012026-03-03T18:57:05.364ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances/{instance}/disks/attach versions = from 2025120300.0.0 to 2026013001.0.0
30022026-03-03T18:57:05.364ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances/{instance}/disks/attach versions = all ending with 2025120300.0.0
30032026-03-03T18:57:05.364ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances/{instance}/disks/detach versions = all starting from 2026013001.0.0
30042026-03-03T18:57:05.364ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances/{instance}/disks/detach versions = from 2025120300.0.0 to 2026013001.0.0
30052026-03-03T18:57:05.364ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances/{instance}/disks/detach versions = all ending with 2025120300.0.0
30062026-03-03T18:57:05.364ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances/{instance}/external-ips versions = all
30072026-03-03T18:57:05.364ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all starting from 2026012300.0.0
30082026-03-03T18:57:05.364ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all ending with 2026012300.0.0
30092026-03-03T18:57:05.364ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all starting from 2026010500.0.0
30102026-03-03T18:57:05.364ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = from 2025122300.0.0 to 2026010500.0.0
30112026-03-03T18:57:05.364ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all ending with 2025122300.0.0
30122026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances/{instance}/external-subnets versions = all starting from 2026013000.0.0
30132026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances/{instance}/multicast-groups versions = all starting from 2026010800.0.0
30142026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances/{instance}/multicast-groups versions = all ending with 2026010800.0.0
30152026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
30162026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
30172026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
30182026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
30192026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances/{instance}/reboot versions = all
30202026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances/{instance}/serial-console versions = all
30212026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
30222026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
30232026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances/{instance}/start versions = all
30242026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/instances/{instance}/stop versions = all
30252026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/internet-gateway-ip-addresses versions = all
30262026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/internet-gateway-ip-addresses versions = all
30272026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
30282026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/internet-gateway-ip-pools versions = all
30292026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/internet-gateway-ip-pools versions = all
30302026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
30312026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/internet-gateways versions = all
30322026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/internet-gateways versions = all
30332026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
30342026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/internet-gateways/{gateway} versions = all
30352026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/ip-pools versions = all starting from 2026020900.0.0
30362026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/ip-pools versions = from 2026010100.0.0 to 2026020900.0.0
30372026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/ip-pools versions = all ending with 2026010100.0.0
30382026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/ip-pools/{pool} versions = all starting from 2026020900.0.0
30392026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/ip-pools/{pool} versions = from 2026010100.0.0 to 2026020900.0.0
30402026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/ip-pools/{pool} versions = all ending with 2026010100.0.0
30412026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/login/{silo_name}/local versions = all
30422026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/logout versions = all
30432026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/me versions = all
30442026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/me/access-tokens versions = all
30452026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/me/access-tokens/{token_id} versions = all
30462026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/me/groups versions = all
30472026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/me/ssh-keys versions = all
30482026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/me/ssh-keys versions = all
30492026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
30502026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
30512026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/metrics/{metric_name} versions = all
30522026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/multicast-groups versions = all starting from 2026010800.0.0
30532026-03-03T18:57:05.365ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/multicast-groups versions = all ending with 2026010800.0.0
30542026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/multicast-groups versions = all ending with 2026010800.0.0
30552026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
30562026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
30572026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
30582026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
30592026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/multicast-groups/{multicast_group}/members versions = all starting from 2026010800.0.0
30602026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/multicast-groups/{multicast_group}/members versions = all ending with 2026010800.0.0
30612026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/multicast-groups/{multicast_group}/members versions = all ending with 2026010800.0.0
30622026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/multicast-groups/{multicast_group}/members/{instance} versions = all ending with 2026010800.0.0
30632026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/network-interfaces versions = all starting from 2026010300.0.0
30642026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/network-interfaces versions = all ending with 2026010300.0.0
30652026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/network-interfaces versions = all starting from 2026010300.0.0
30662026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/network-interfaces versions = all ending with 2026010300.0.0
30672026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/network-interfaces/{interface} versions = all
30682026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/network-interfaces/{interface} versions = all starting from 2026010300.0.0
30692026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/network-interfaces/{interface} versions = all ending with 2026010300.0.0
30702026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/network-interfaces/{interface} versions = all starting from 2026010300.0.0
30712026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/network-interfaces/{interface} versions = all ending with 2026010300.0.0
30722026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/ping versions = all
30732026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/policy versions = all
30742026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/policy versions = all
30752026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/projects versions = all
30762026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/projects versions = all
30772026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/projects/{project} versions = all
30782026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/projects/{project} versions = all
30792026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/projects/{project} versions = all
30802026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/projects/{project}/policy versions = all
30812026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/projects/{project}/policy versions = all
30822026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/snapshots versions = all
30832026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/snapshots versions = all
30842026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/snapshots/{snapshot} versions = all
30852026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/snapshots/{snapshot} versions = all
30862026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/subnet-pools versions = all starting from 2026020900.0.0
30872026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/subnet-pools versions = from 2026020600.0.0 to 2026020900.0.0
30882026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/subnet-pools/{pool} versions = all starting from 2026020900.0.0
30892026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/audit-log versions = all
30902026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/disks versions = all
30912026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
30922026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
30932026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/racks versions = all
30942026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
30952026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/racks/{rack_id}/membership versions = all starting from 2026012100.0.0
30962026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/hardware/racks/{rack_id}/membership/abort versions = all starting from 2026020200.0.0
30972026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/hardware/racks/{rack_id}/membership/add versions = all starting from 2026012100.0.0
30982026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/sleds versions = all
30992026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/hardware/sleds versions = all ending with 2026021900.0.0
31002026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
31012026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
31022026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
31032026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
31042026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
31052026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/switch-port versions = all
31062026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
31072026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
31082026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
31092026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
31102026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
31112026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/switches versions = all
31122026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
31132026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/identity-providers versions = all
31142026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/identity-providers/local/users versions = all
31152026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
31162026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
31172026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/identity-providers/saml versions = all
31182026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
31192026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools versions = all starting from 2026020900.0.0
31202026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools versions = all ending with 2026020900.0.0
31212026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/ip-pools versions = all starting from 2026020900.0.0
31222026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/ip-pools versions = all ending with 2026020900.0.0
31232026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
31242026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
31252026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
31262026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
31272026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
31282026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
31292026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all starting from 2026020900.0.0
31302026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all ending with 2026020900.0.0
31312026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all starting from 2026020900.0.0
31322026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all ending with 2026020900.0.0
31332026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all starting from 2026020900.0.0
31342026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all ending with 2026020900.0.0
31352026-03-03T18:57:05.366ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all starting from 2026020900.0.0
31362026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all ending with 2026020900.0.0
31372026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all starting from 2026020900.0.0
31382026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all ending with 2026020900.0.0
31392026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
31402026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all ending with 2026020900.0.0
31412026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
31422026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all ending with 2026020900.0.0
31432026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all starting from 2026020900.0.0
31442026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all ending with 2026020900.0.0
31452026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools-service versions = all starting from 2026020900.0.0
31462026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools-service versions = all ending with 2026020900.0.0
31472026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools-service/ranges versions = all starting from 2026020900.0.0
31482026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/ip-pools-service/ranges versions = all ending with 2026020900.0.0
31492026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all starting from 2026020900.0.0
31502026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all ending with 2026020900.0.0
31512026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all starting from 2026020900.0.0
31522026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all ending with 2026020900.0.0
31532026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/metrics/{metric_name} versions = all
31542026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/multicast-groups/by-ip/{address} versions = all ending with 2026010800.0.0
31552026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/address-lot versions = all
31562026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/networking/address-lot versions = all
31572026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
31582026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/address-lot/{address_lot} versions = all
31592026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
31602026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/allow-list versions = all
31612026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/networking/allow-list versions = all
31622026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/networking/bfd-disable versions = all
31632026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/networking/bfd-enable versions = all
31642026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/bfd-status versions = all
31652026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/networking/bgp versions = all
31662026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/bgp versions = all starting from 2026021301.0.0
31672026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/bgp versions = all ending with 2026021301.0.0
31682026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/networking/bgp versions = all starting from 2026021301.0.0
31692026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/networking/bgp versions = all ending with 2026021301.0.0
31702026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/bgp-announce-set versions = all
31712026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
31722026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
31732026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
31742026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/bgp-exported versions = all starting from 2026021301.0.0
31752026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/bgp-exported versions = all ending with 2026021301.0.0
31762026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/bgp-imported versions = all starting from 2026021301.0.0
31772026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/bgp-message-history versions = all
31782026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all ending with 2026021301.0.0
31792026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/bgp-status versions = all starting from 2026021301.0.0
31802026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/bgp-status versions = from 2025121200.0.0 to 2026021301.0.0
31812026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/bgp-status versions = all ending with 2025121200.0.0
31822026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/inbound-icmp versions = all
31832026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/networking/inbound-icmp versions = all
31842026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/loopback-address versions = all
31852026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/networking/loopback-address versions = all
31862026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
31872026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
31882026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/switch-port-settings versions = all
31892026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/networking/switch-port-settings versions = all starting from 2026021301.0.0
31902026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/networking/switch-port-settings versions = all ending with 2026021301.0.0
31912026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all starting from 2026021301.0.0
31922026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all ending with 2026021301.0.0
31932026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/policy versions = all
31942026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/policy versions = all
31952026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/scim/tokens versions = all
31962026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/scim/tokens versions = all
31972026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/scim/tokens/{token_id} versions = all
31982026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/scim/tokens/{token_id} versions = all
31992026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/silo-quotas versions = all
32002026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/silos versions = all
32012026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/silos versions = all
32022026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/silos/{silo} versions = all
32032026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/silos/{silo} versions = all
32042026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all starting from 2026010100.0.0
32052026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all ending with 2026010100.0.0
32062026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/silos/{silo}/policy versions = all
32072026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/silos/{silo}/policy versions = all
32082026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/silos/{silo}/quotas versions = all
32092026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
32102026-03-03T18:57:05.367ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/silos/{silo}/subnet-pools versions = all starting from 2026020600.0.0
32112026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/subnet-pools versions = all starting from 2026020900.0.0
32122026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/subnet-pools versions = from 2026012800.0.0 to 2026020900.0.0
32132026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/subnet-pools versions = from 2026011601.0.0 to 2026012800.0.0
32142026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/subnet-pools versions = all starting from 2026020900.0.0
32152026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/subnet-pools versions = from 2026012800.0.0 to 2026020900.0.0
32162026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/subnet-pools versions = from 2026012201.0.0 to 2026012800.0.0
32172026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/subnet-pools versions = from 2026011601.0.0 to 2026012201.0.0
32182026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
32192026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026020900.0.0
32202026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
32212026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/subnet-pools/{pool} versions = from 2026012800.0.0 to 2026020900.0.0
32222026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026012800.0.0
32232026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
32242026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/subnet-pools/{pool} versions = from 2026012800.0.0 to 2026020900.0.0
32252026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026012800.0.0
32262026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/subnet-pools/{pool}/members versions = all starting from 2026020900.0.0
32272026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/subnet-pools/{pool}/members versions = from 2026012800.0.0 to 2026020900.0.0
32282026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/subnet-pools/{pool}/members versions = from 2026011601.0.0 to 2026012800.0.0
32292026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = all starting from 2026020900.0.0
32302026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026012800.0.0 to 2026020900.0.0
32312026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026012201.0.0 to 2026012800.0.0
32322026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026011601.0.0 to 2026012201.0.0
32332026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/subnet-pools/{pool}/members/remove versions = all starting from 2026020900.0.0
32342026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/subnet-pools/{pool}/members/remove versions = from 2026011601.0.0 to 2026020900.0.0
32352026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/subnet-pools/{pool}/silos versions = all starting from 2026020900.0.0
32362026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/subnet-pools/{pool}/silos versions = from 2026011601.0.0 to 2026020900.0.0
32372026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/subnet-pools/{pool}/silos versions = all starting from 2026020900.0.0
32382026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/subnet-pools/{pool}/silos versions = from 2026011601.0.0 to 2026020900.0.0
32392026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
32402026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = from 2026011601.0.0 to 2026020900.0.0
32412026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
32422026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = from 2026011601.0.0 to 2026020900.0.0
32432026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/subnet-pools/{pool}/utilization versions = all starting from 2026020900.0.0
32442026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/subnet-pools/{pool}/utilization versions = from 2026011601.0.0 to 2026020900.0.0
32452026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/timeseries/query versions = all
32462026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/timeseries/schemas versions = all
32472026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/update/repositories versions = all
32482026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/update/repositories versions = all
32492026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/update/repositories/{system_version} versions = all
32502026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/update/status versions = all
32512026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/system/update/target-release versions = all
32522026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/update/trust-roots versions = all
32532026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/system/update/trust-roots versions = all
32542026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/system/update/trust-roots/{trust_root_id} versions = all
32552026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/update/trust-roots/{trust_root_id} versions = all
32562026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/users versions = all
32572026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/users/{user_id} versions = all
32582026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/users-builtin versions = all
32592026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/users-builtin/{user} versions = all
32602026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/utilization/silos versions = all
32612026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/system/utilization/silos/{silo} versions = all
32622026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/timeseries/query versions = all
32632026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/users versions = all
32642026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/users/{user_id} versions = all
32652026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/users/{user_id}/access-tokens versions = all
32662026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/users/{user_id}/logout versions = all
32672026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/users/{user_id}/sessions versions = all
32682026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/utilization versions = all
32692026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/vpc-firewall-rules versions = all
32702026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/vpc-firewall-rules versions = all
32712026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/vpc-router-routes versions = all
32722026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/vpc-router-routes versions = all
32732026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
32742026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/vpc-router-routes/{route} versions = all
32752026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/vpc-router-routes/{route} versions = all
32762026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/vpc-routers versions = all
32772026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/vpc-routers versions = all
32782026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/vpc-routers/{router} versions = all
32792026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/vpc-routers/{router} versions = all
32802026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/vpc-routers/{router} versions = all
32812026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/vpc-subnets versions = all
32822026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/vpc-subnets versions = all
32832026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
32842026-03-03T18:57:05.368ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/vpc-subnets/{subnet} versions = all
32852026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
32862026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all starting from 2026010300.0.0
32872026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all ending with 2026010300.0.0
32882026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/vpcs versions = all
32892026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/vpcs versions = all
32902026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/vpcs/{vpc} versions = all
32912026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/vpcs/{vpc} versions = all
32922026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/vpcs/{vpc} versions = all
32932026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/webhook-receivers versions = all
32942026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = PUT path = /v1/webhook-receivers/{receiver} versions = all
32952026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = GET path = /v1/webhook-secrets versions = all
32962026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = POST path = /v1/webhook-secrets versions = all
32972026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:37769 method = DELETE path = /v1/webhook-secrets/{secret_id} versions = all
32982026-03-03T18:57:05.369ZINFOtest_metrics (dropshot_external): listening local_addr = 127.0.0.1:37769
32992026-03-03T18:57:05.369ZDEBGtest_metrics (dropshot_external): successfully registered DTrace USDT probes local_addr = 127.0.0.1:37769
33002026-03-03T18:57:05.381ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = / versions = all
33012026-03-03T18:57:05.381ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /access versions = all
33022026-03-03T18:57:05.381ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /assets/{path} versions = all
33032026-03-03T18:57:05.381ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /device/auth versions = all
33042026-03-03T18:57:05.381ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /device/confirm versions = all
33052026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /device/success versions = all
33062026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /device/token versions = all
33072026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /device/verify versions = all
33082026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /experimental/v1/probes versions = all starting from 2026010300.0.0
33092026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /experimental/v1/probes versions = all ending with 2026010300.0.0
33102026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /experimental/v1/probes versions = all starting from 2026010500.0.0
33112026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /experimental/v1/probes versions = all ending with 2026010500.0.0
33122026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /experimental/v1/probes/{probe} versions = all
33132026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /experimental/v1/probes/{probe} versions = all starting from 2026010300.0.0
33142026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /experimental/v1/probes/{probe} versions = all ending with 2026010300.0.0
33152026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /experimental/v1/system/support-bundles versions = all
33162026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /experimental/v1/system/support-bundles versions = all
33172026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
33182026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
33192026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
33202026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
33212026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
33222026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
33232026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
33242026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/index versions = all
33252026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /images versions = all
33262026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /login versions = all
33272026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /login/{silo_name}/local versions = all
33282026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
33292026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
33302026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
33312026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /lookup/{path} versions = all
33322026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /projects/{path} versions = all
33332026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /projects-new versions = all
33342026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /scim/v2/Groups versions = all
33352026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /scim/v2/Groups versions = all
33362026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /scim/v2/Groups/{group_id} versions = all
33372026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /scim/v2/Groups/{group_id} versions = all
33382026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PATCH path = /scim/v2/Groups/{group_id} versions = all
33392026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /scim/v2/Groups/{group_id} versions = all
33402026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /scim/v2/Users versions = all
33412026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /scim/v2/Users versions = all
33422026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /scim/v2/Users/{user_id} versions = all
33432026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /scim/v2/Users/{user_id} versions = all
33442026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PATCH path = /scim/v2/Users/{user_id} versions = all
33452026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /scim/v2/Users/{user_id} versions = all
33462026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /settings/{path} versions = all
33472026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /system/{path} versions = all
33482026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /utilization versions = all
33492026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/affinity-groups versions = all
33502026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/affinity-groups versions = all
33512026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
33522026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
33532026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
33542026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
33552026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
33562026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
33572026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
33582026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/alert-classes versions = all
33592026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/alert-receivers versions = all
33602026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/alert-receivers/{receiver} versions = all
33612026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/alert-receivers/{receiver} versions = all
33622026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/alert-receivers/{receiver}/deliveries versions = all
33632026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/alert-receivers/{receiver}/probe versions = all
33642026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/alert-receivers/{receiver}/subscriptions versions = all
33652026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/alert-receivers/{receiver}/subscriptions/{subscription} versions = all
33662026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/alerts/{alert_id}/resend versions = all
33672026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/anti-affinity-groups versions = all
33682026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/anti-affinity-groups versions = all
33692026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
33702026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
33712026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
33722026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
33732026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
33742026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
33752026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
33762026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/auth-settings versions = all
33772026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/auth-settings versions = all
33782026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/certificates versions = all
33792026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/certificates versions = all
33802026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/certificates/{certificate} versions = all
33812026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/certificates/{certificate} versions = all
33822026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/disks versions = all starting from 2026013001.0.0
33832026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/disks versions = from 2025120300.0.0 to 2026013001.0.0
33842026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/disks versions = all ending with 2025120300.0.0
33852026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/disks versions = all starting from 2026013100.0.0
33862026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/disks versions = from 2026013001.0.0 to 2026013100.0.0
33872026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/disks versions = from 2025120300.0.0 to 2026013001.0.0
33882026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/disks versions = all ending with 2025120300.0.0
33892026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/disks/{disk} versions = all
33902026-03-03T18:57:05.382ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/disks/{disk} versions = all starting from 2026013001.0.0
33912026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/disks/{disk} versions = from 2025120300.0.0 to 2026013001.0.0
33922026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/disks/{disk} versions = all ending with 2025120300.0.0
33932026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/disks/{disk}/bulk-write versions = all
33942026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
33952026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
33962026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/disks/{disk}/finalize versions = all
33972026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/external-subnets versions = all starting from 2026011601.0.0
33982026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/external-subnets versions = all starting from 2026012201.0.0
33992026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/external-subnets versions = from 2026011601.0.0 to 2026012201.0.0
34002026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
34012026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
34022026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
34032026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/external-subnets/{external_subnet}/attach versions = all starting from 2026011601.0.0
34042026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/external-subnets/{external_subnet}/detach versions = all starting from 2026011601.0.0
34052026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/floating-ips versions = all
34062026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/floating-ips versions = all starting from 2026012200.0.0
34072026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/floating-ips versions = from 2026011600.0.0 to 2026012200.0.0
34082026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/floating-ips versions = from 2026010500.0.0 to 2026011600.0.0
34092026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/floating-ips versions = from 2025122300.0.0 to 2026010500.0.0
34102026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/floating-ips versions = all ending with 2025122300.0.0
34112026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
34122026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/floating-ips/{floating_ip} versions = all
34132026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
34142026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
34152026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
34162026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/groups versions = all
34172026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/groups/{group_id} versions = all
34182026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/images versions = all
34192026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/images versions = all
34202026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/images/{image} versions = all
34212026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/images/{image} versions = all
34222026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/images/{image}/demote versions = all
34232026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/images/{image}/promote versions = all
34242026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances versions = all
34252026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances versions = all starting from 2026013100.0.0
34262026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances versions = from 2026013001.0.0 to 2026013100.0.0
34272026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances versions = from 2026010800.0.0 to 2026013001.0.0
34282026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances versions = from 2026010500.0.0 to 2026010800.0.0
34292026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances versions = from 2026010300.0.0 to 2026010500.0.0
34302026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances versions = from 2025122300.0.0 to 2026010300.0.0
34312026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances versions = from 2025120300.0.0 to 2025122300.0.0
34322026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances versions = all ending with 2025120300.0.0
34332026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/instances/{instance} versions = all
34342026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances/{instance} versions = all
34352026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/instances/{instance} versions = all starting from 2026010800.0.0
34362026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/instances/{instance} versions = all ending with 2026010800.0.0
34372026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances/{instance}/affinity-groups versions = all
34382026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances/{instance}/anti-affinity-groups versions = all
34392026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances/{instance}/disks versions = all starting from 2026013001.0.0
34402026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances/{instance}/disks versions = from 2025120300.0.0 to 2026013001.0.0
34412026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances/{instance}/disks versions = all ending with 2025120300.0.0
34422026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances/{instance}/disks/attach versions = all starting from 2026013001.0.0
34432026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances/{instance}/disks/attach versions = from 2025120300.0.0 to 2026013001.0.0
34442026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances/{instance}/disks/attach versions = all ending with 2025120300.0.0
34452026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances/{instance}/disks/detach versions = all starting from 2026013001.0.0
34462026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances/{instance}/disks/detach versions = from 2025120300.0.0 to 2026013001.0.0
34472026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances/{instance}/disks/detach versions = all ending with 2025120300.0.0
34482026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances/{instance}/external-ips versions = all
34492026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all starting from 2026012300.0.0
34502026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all ending with 2026012300.0.0
34512026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all starting from 2026010500.0.0
34522026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = from 2025122300.0.0 to 2026010500.0.0
34532026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all ending with 2025122300.0.0
34542026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances/{instance}/external-subnets versions = all starting from 2026013000.0.0
34552026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances/{instance}/multicast-groups versions = all starting from 2026010800.0.0
34562026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances/{instance}/multicast-groups versions = all ending with 2026010800.0.0
34572026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
34582026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
34592026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
34602026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
34612026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances/{instance}/reboot versions = all
34622026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances/{instance}/serial-console versions = all
34632026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
34642026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
34652026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances/{instance}/start versions = all
34662026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/instances/{instance}/stop versions = all
34672026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/internet-gateway-ip-addresses versions = all
34682026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/internet-gateway-ip-addresses versions = all
34692026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
34702026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/internet-gateway-ip-pools versions = all
34712026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/internet-gateway-ip-pools versions = all
34722026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
34732026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/internet-gateways versions = all
34742026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/internet-gateways versions = all
34752026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
34762026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/internet-gateways/{gateway} versions = all
34772026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/ip-pools versions = all starting from 2026020900.0.0
34782026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/ip-pools versions = from 2026010100.0.0 to 2026020900.0.0
34792026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/ip-pools versions = all ending with 2026010100.0.0
34802026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/ip-pools/{pool} versions = all starting from 2026020900.0.0
34812026-03-03T18:57:05.383ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/ip-pools/{pool} versions = from 2026010100.0.0 to 2026020900.0.0
34822026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/ip-pools/{pool} versions = all ending with 2026010100.0.0
34832026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/login/{silo_name}/local versions = all
34842026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/logout versions = all
34852026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/me versions = all
34862026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/me/access-tokens versions = all
34872026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/me/access-tokens/{token_id} versions = all
34882026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/me/groups versions = all
34892026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/me/ssh-keys versions = all
34902026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/me/ssh-keys versions = all
34912026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
34922026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
34932026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/metrics/{metric_name} versions = all
34942026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/multicast-groups versions = all starting from 2026010800.0.0
34952026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/multicast-groups versions = all ending with 2026010800.0.0
34962026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/multicast-groups versions = all ending with 2026010800.0.0
34972026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
34982026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
34992026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
35002026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
35012026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/multicast-groups/{multicast_group}/members versions = all starting from 2026010800.0.0
35022026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/multicast-groups/{multicast_group}/members versions = all ending with 2026010800.0.0
35032026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/multicast-groups/{multicast_group}/members versions = all ending with 2026010800.0.0
35042026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/multicast-groups/{multicast_group}/members/{instance} versions = all ending with 2026010800.0.0
35052026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/network-interfaces versions = all starting from 2026010300.0.0
35062026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/network-interfaces versions = all ending with 2026010300.0.0
35072026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/network-interfaces versions = all starting from 2026010300.0.0
35082026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/network-interfaces versions = all ending with 2026010300.0.0
35092026-03-03T18:57:05.384ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/network-interfaces/{interface} versions = all
35102026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/network-interfaces/{interface} versions = all starting from 2026010300.0.0
35112026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/network-interfaces/{interface} versions = all ending with 2026010300.0.0
35122026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/network-interfaces/{interface} versions = all starting from 2026010300.0.0
35132026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/network-interfaces/{interface} versions = all ending with 2026010300.0.0
35142026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/ping versions = all
35152026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/policy versions = all
35162026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/policy versions = all
35172026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/projects versions = all
35182026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/projects versions = all
35192026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/projects/{project} versions = all
35202026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/projects/{project} versions = all
35212026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/projects/{project} versions = all
35222026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/projects/{project}/policy versions = all
35232026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/projects/{project}/policy versions = all
35242026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/snapshots versions = all
35252026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/snapshots versions = all
35262026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/snapshots/{snapshot} versions = all
35272026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/snapshots/{snapshot} versions = all
35282026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/subnet-pools versions = all starting from 2026020900.0.0
35292026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/subnet-pools versions = from 2026020600.0.0 to 2026020900.0.0
35302026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/subnet-pools/{pool} versions = all starting from 2026020900.0.0
35312026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/audit-log versions = all
35322026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/disks versions = all
35332026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
35342026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
35352026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/racks versions = all
35362026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
35372026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/racks/{rack_id}/membership versions = all starting from 2026012100.0.0
35382026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/hardware/racks/{rack_id}/membership/abort versions = all starting from 2026020200.0.0
35392026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/hardware/racks/{rack_id}/membership/add versions = all starting from 2026012100.0.0
35402026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/sleds versions = all
35412026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/hardware/sleds versions = all ending with 2026021900.0.0
35422026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
35432026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
35442026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
35452026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
35462026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
35472026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/switch-port versions = all
35482026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
35492026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
35502026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
35512026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
35522026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
35532026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/switches versions = all
35542026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
35552026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/identity-providers versions = all
35562026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/identity-providers/local/users versions = all
35572026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
35582026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
35592026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/identity-providers/saml versions = all
35602026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
35612026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools versions = all starting from 2026020900.0.0
35622026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools versions = all ending with 2026020900.0.0
35632026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/ip-pools versions = all starting from 2026020900.0.0
35642026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/ip-pools versions = all ending with 2026020900.0.0
35652026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
35662026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
35672026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
35682026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
35692026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
35702026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
35712026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all starting from 2026020900.0.0
35722026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all ending with 2026020900.0.0
35732026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all starting from 2026020900.0.0
35742026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all ending with 2026020900.0.0
35752026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all starting from 2026020900.0.0
35762026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all ending with 2026020900.0.0
35772026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all starting from 2026020900.0.0
35782026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all ending with 2026020900.0.0
35792026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all starting from 2026020900.0.0
35802026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all ending with 2026020900.0.0
35812026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
35822026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all ending with 2026020900.0.0
35832026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
35842026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all ending with 2026020900.0.0
35852026-03-03T18:57:05.386ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all starting from 2026020900.0.0
35862026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all ending with 2026020900.0.0
35872026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools-service versions = all starting from 2026020900.0.0
35882026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools-service versions = all ending with 2026020900.0.0
35892026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools-service/ranges versions = all starting from 2026020900.0.0
35902026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/ip-pools-service/ranges versions = all ending with 2026020900.0.0
35912026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all starting from 2026020900.0.0
35922026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all ending with 2026020900.0.0
35932026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all starting from 2026020900.0.0
35942026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all ending with 2026020900.0.0
35952026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/metrics/{metric_name} versions = all
35962026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/multicast-groups/by-ip/{address} versions = all ending with 2026010800.0.0
35972026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/address-lot versions = all
35982026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/networking/address-lot versions = all
35992026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
36002026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/address-lot/{address_lot} versions = all
36012026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
36022026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/allow-list versions = all
36032026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/networking/allow-list versions = all
36042026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/networking/bfd-disable versions = all
36052026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/networking/bfd-enable versions = all
36062026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/bfd-status versions = all
36072026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/networking/bgp versions = all
36082026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/bgp versions = all starting from 2026021301.0.0
36092026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/bgp versions = all ending with 2026021301.0.0
36102026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/networking/bgp versions = all starting from 2026021301.0.0
36112026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/networking/bgp versions = all ending with 2026021301.0.0
36122026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/bgp-announce-set versions = all
36132026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
36142026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
36152026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
36162026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/bgp-exported versions = all starting from 2026021301.0.0
36172026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/bgp-exported versions = all ending with 2026021301.0.0
36182026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/bgp-imported versions = all starting from 2026021301.0.0
36192026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/bgp-message-history versions = all
36202026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all ending with 2026021301.0.0
36212026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/bgp-status versions = all starting from 2026021301.0.0
36222026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/bgp-status versions = from 2025121200.0.0 to 2026021301.0.0
36232026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/bgp-status versions = all ending with 2025121200.0.0
36242026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/inbound-icmp versions = all
36252026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/networking/inbound-icmp versions = all
36262026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/loopback-address versions = all
36272026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/networking/loopback-address versions = all
36282026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
36292026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
36302026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/switch-port-settings versions = all
36312026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/networking/switch-port-settings versions = all starting from 2026021301.0.0
36322026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/networking/switch-port-settings versions = all ending with 2026021301.0.0
36332026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all starting from 2026021301.0.0
36342026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all ending with 2026021301.0.0
36352026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/policy versions = all
36362026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/policy versions = all
36372026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/scim/tokens versions = all
36382026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/scim/tokens versions = all
36392026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/scim/tokens/{token_id} versions = all
36402026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/scim/tokens/{token_id} versions = all
36412026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/silo-quotas versions = all
36422026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/silos versions = all
36432026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/silos versions = all
36442026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/silos/{silo} versions = all
36452026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/silos/{silo} versions = all
36462026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all starting from 2026010100.0.0
36472026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all ending with 2026010100.0.0
36482026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/silos/{silo}/policy versions = all
36492026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/silos/{silo}/policy versions = all
36502026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/silos/{silo}/quotas versions = all
36512026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
36522026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/silos/{silo}/subnet-pools versions = all starting from 2026020600.0.0
36532026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/subnet-pools versions = all starting from 2026020900.0.0
36542026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/subnet-pools versions = from 2026012800.0.0 to 2026020900.0.0
36552026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/subnet-pools versions = from 2026011601.0.0 to 2026012800.0.0
36562026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/subnet-pools versions = all starting from 2026020900.0.0
36572026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/subnet-pools versions = from 2026012800.0.0 to 2026020900.0.0
36582026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/subnet-pools versions = from 2026012201.0.0 to 2026012800.0.0
36592026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/subnet-pools versions = from 2026011601.0.0 to 2026012201.0.0
36602026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
36612026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026020900.0.0
36622026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
36632026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/subnet-pools/{pool} versions = from 2026012800.0.0 to 2026020900.0.0
36642026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026012800.0.0
36652026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
36662026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/subnet-pools/{pool} versions = from 2026012800.0.0 to 2026020900.0.0
36672026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026012800.0.0
36682026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/subnet-pools/{pool}/members versions = all starting from 2026020900.0.0
36692026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/subnet-pools/{pool}/members versions = from 2026012800.0.0 to 2026020900.0.0
36702026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/subnet-pools/{pool}/members versions = from 2026011601.0.0 to 2026012800.0.0
36712026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = all starting from 2026020900.0.0
36722026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026012800.0.0 to 2026020900.0.0
36732026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026012201.0.0 to 2026012800.0.0
36742026-03-03T18:57:05.387ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026011601.0.0 to 2026012201.0.0
36752026-03-03T18:57:05.389ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/subnet-pools/{pool}/members/remove versions = all starting from 2026020900.0.0
36762026-03-03T18:57:05.389ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/subnet-pools/{pool}/members/remove versions = from 2026011601.0.0 to 2026020900.0.0
36772026-03-03T18:57:05.389ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/subnet-pools/{pool}/silos versions = all starting from 2026020900.0.0
36782026-03-03T18:57:05.389ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/subnet-pools/{pool}/silos versions = from 2026011601.0.0 to 2026020900.0.0
36792026-03-03T18:57:05.389ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/subnet-pools/{pool}/silos versions = all starting from 2026020900.0.0
36802026-03-03T18:57:05.389ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/subnet-pools/{pool}/silos versions = from 2026011601.0.0 to 2026020900.0.0
36812026-03-03T18:57:05.389ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
36822026-03-03T18:57:05.389ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = from 2026011601.0.0 to 2026020900.0.0
36832026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
36842026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = from 2026011601.0.0 to 2026020900.0.0
36852026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/subnet-pools/{pool}/utilization versions = all starting from 2026020900.0.0
36862026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/subnet-pools/{pool}/utilization versions = from 2026011601.0.0 to 2026020900.0.0
36872026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/timeseries/query versions = all
36882026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/timeseries/schemas versions = all
36892026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/update/repositories versions = all
36902026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/update/repositories versions = all
36912026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/update/repositories/{system_version} versions = all
36922026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/update/status versions = all
36932026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/system/update/target-release versions = all
36942026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/update/trust-roots versions = all
36952026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/system/update/trust-roots versions = all
36962026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/system/update/trust-roots/{trust_root_id} versions = all
36972026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/update/trust-roots/{trust_root_id} versions = all
36982026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/users versions = all
36992026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/users/{user_id} versions = all
37002026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/users-builtin versions = all
37012026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/users-builtin/{user} versions = all
37022026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/utilization/silos versions = all
37032026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/system/utilization/silos/{silo} versions = all
37042026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/timeseries/query versions = all
37052026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/users versions = all
37062026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/users/{user_id} versions = all
37072026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/users/{user_id}/access-tokens versions = all
37082026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/users/{user_id}/logout versions = all
37092026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/users/{user_id}/sessions versions = all
37102026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/utilization versions = all
37112026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/vpc-firewall-rules versions = all
37122026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/vpc-firewall-rules versions = all
37132026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/vpc-router-routes versions = all
37142026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/vpc-router-routes versions = all
37152026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
37162026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/vpc-router-routes/{route} versions = all
37172026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/vpc-router-routes/{route} versions = all
37182026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/vpc-routers versions = all
37192026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/vpc-routers versions = all
37202026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/vpc-routers/{router} versions = all
37212026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/vpc-routers/{router} versions = all
37222026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/vpc-routers/{router} versions = all
37232026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/vpc-subnets versions = all
37242026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/vpc-subnets versions = all
37252026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
37262026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/vpc-subnets/{subnet} versions = all
37272026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
37282026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all starting from 2026010300.0.0
37292026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all ending with 2026010300.0.0
37302026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/vpcs versions = all
37312026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/vpcs versions = all
37322026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/vpcs/{vpc} versions = all
37332026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/vpcs/{vpc} versions = all
37342026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/vpcs/{vpc} versions = all
37352026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/webhook-receivers versions = all
37362026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = PUT path = /v1/webhook-receivers/{receiver} versions = all
37372026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = GET path = /v1/webhook-secrets versions = all
37382026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = POST path = /v1/webhook-secrets versions = all
37392026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:46641 method = DELETE path = /v1/webhook-secrets/{secret_id} versions = all
37402026-03-03T18:57:05.395ZINFOtest_metrics (dropshot_external_techport): listening local_addr = 127.0.0.1:46641
37412026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = 127.0.0.1:46641
37422026-03-03T18:57:05.395ZDEBGtest_metrics (nexus-producer-server): registered DTrace probes
37432026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot): registered endpoint local_addr = 127.0.0.1:41769 method = GET path = /{producer_id} versions = all
37442026-03-03T18:57:05.395ZINFOtest_metrics (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = 127.0.0.1:41769
37452026-03-03T18:57:05.395ZDEBGtest_metrics (dropshot): successfully registered DTrace USDT probes local_addr = 127.0.0.1:41769
37462026-03-03T18:57:05.395ZDEBGtest_metrics (nexus-producer-server): Requested any available port, Dropshot server has been bound to 127.0.0.1:41769
37472026-03-03T18:57:05.395ZDEBGtest_metrics (nexus-producer-server): Nexus IP provided explicitly, will use it addr = 127.0.0.1:41339
37482026-03-03T18:57:05.395ZDEBGtest_metrics (nexus-producer-server): starting producer registration task
37492026-03-03T18:57:05.395ZINFOtest_metrics (nexus-producer-server): starting oximeter metric producer server address = 127.0.0.1:41769 file = oximeter/producer/src/lib.rs:281 interval = 10s producer_id = 913233fe-92a8-4635-9572-183f495429c4
37502026-03-03T18:57:05.395ZDEBGtest_metrics (init_with_steps): Running step start_oximeter
37512026-03-03T18:57:05.396ZDEBGtest_metrics: Starting Oximeter
37522026-03-03T18:57:05.396ZDEBGtest_metrics (oximeter): registered DTrace probes
37532026-03-03T18:57:05.396ZINFOtest_metrics (oximeter): starting oximeter server file = oximeter/collector/src/lib.rs:264
37542026-03-03T18:57:05.396ZDEBGtest_metrics (oximeter): creating ClickHouse client
37552026-03-03T18:57:05.396ZDEBGtest_metrics (clickhouse-client): registered USDT probes collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
37562026-03-03T18:57:05.396ZDEBGtest_metrics (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0
37572026-03-03T18:57:05.396ZDEBGtest_metrics (producer-registration-task): will register with Nexus at 127.0.0.1:41339
37582026-03-03T18:57:05.396ZDEBGtest_metrics (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:41339/metrics/producers
37592026-03-03T18:57:05.396ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:41339 remote_addr = 127.0.0.1:36728
37602026-03-03T18:57:05.400ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36728 req_id = 578cdffc-b455-4b16-9c66-4745f62f3908 uri = /metrics/producers
37612026-03-03T18:57:05.400ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36728 req_id = 578cdffc-b455-4b16-9c66-4745f62f3908 uri = /metrics/producers version = 1.0.0
37622026-03-03T18:57:05.400ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36728 req_id = 578cdffc-b455-4b16-9c66-4745f62f3908 resource = Database type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
37632026-03-03T18:57:05.400ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36728 req_id = 578cdffc-b455-4b16-9c66-4745f62f3908 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
37642026-03-03T18:57:05.400ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36728 req_id = 578cdffc-b455-4b16-9c66-4745f62f3908 resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
37652026-03-03T18:57:05.420ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = SELECT MAX(value) AS max_version FROM oximeter.version;
37662026-03-03T18:57:05.428ZWARNtest_metrics (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:900 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
37672026-03-03T18:57:05.428ZDEBGtest_metrics (oximeter-agent): oximeter database does not exist, creating collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
37682026-03-03T18:57:05.428ZINFOtest_metrics (clickhouse-client): reading db version collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:800 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
37692026-03-03T18:57:05.429ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = SELECT MAX(value) AS max_version FROM oximeter.version;
37702026-03-03T18:57:05.437ZWARNtest_metrics (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:900 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
37712026-03-03T18:57:05.439ZINFOtest_metrics (clickhouse-client): read oximeter database version collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:805 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af version = 0
37722026-03-03T18:57:05.439ZINFOtest_metrics (clickhouse-client): initializing oximeter schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:810 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
37732026-03-03T18:57:05.439ZDEBGtest_metrics (clickhouse-client): initializing ClickHouse database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
37742026-03-03T18:57:05.439ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = CREATE DATABASE IF NOT EXISTS oximeter
37752026-03-03T18:57:05.442ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\n/* The version table contains metadata about the `oximeter` database */\nCREATE TABLE IF NOT EXISTS oximeter.version\n(\n value UInt64,\n timestamp DateTime64(9, 'UTC')\n)\nENGINE = MergeTree()\nORDER BY (value, timestamp)
37762026-03-03T18:57:05.449ZINFOtest_metrics (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no Oximeter instances available for assignment latency_us = 53540 local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36728 req_id = 578cdffc-b455-4b16-9c66-4745f62f3908 response_code = 503 uri = /metrics/producers
37772026-03-03T18:57:05.450ZDEBGtest_metrics (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "578cdffc-b455-4b16-9c66-4745f62f3908", "content-length": "133", "date": "Tue, 03 Mar 2026 18:57:05 GMT"} })
37782026-03-03T18:57:05.450ZWARNtest_metrics (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 66.160992ms error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "578cdffc-b455-4b16-9c66-4745f62f3908", "content-length": "133", "date": "Tue, 03 Mar 2026 18:57:05 GMT"}; value: Error { error_code: Some("ServiceNotAvailable"), message: "Service Unavailable", request_id: "578cdffc-b455-4b16-9c66-4745f62f3908" } file = oximeter/producer/src/lib.rs:377
37792026-03-03T18:57:05.462ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 135.240178ms iteration = 3 status = {"Loaded":{"collection_id":"7b3e1531-9e16-46a8-b395-70c01b6466c5","time_loaded":"2026-03-03T18:57:05.327663650Z","time_started":"2026-03-03T18:57:04.613229Z"}}
37802026-03-03T18:57:05.463ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 3 reason = Dependency
37812026-03-03T18:57:05.463ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
37822026-03-03T18:57:05.463ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
37832026-03-03T18:57:05.463ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
37842026-03-03T18:57:05.463ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 5 reason = Dependency
37852026-03-03T18:57:05.463ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
37862026-03-03T18:57:05.463ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 21.95\u{b5}s iteration = 5 status = "Disabled"
37872026-03-03T18:57:05.463ZDEBGtest_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
37882026-03-03T18:57:05.463ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 11.71\u{b5}s iteration = 3 status = {"error":"task disabled"}
37892026-03-03T18:57:05.463ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 3 reason = Dependency
37902026-03-03T18:57:05.463ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
37912026-03-03T18:57:05.463ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
37922026-03-03T18:57:05.463ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
37932026-03-03T18:57:05.463ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
37942026-03-03T18:57:05.464ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
37952026-03-03T18:57:05.466ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: ca e8 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:37709 req_id = 79f93862-f63b-4f74-9b67-c44ef02b8633
37962026-03-03T18:57:05.466ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 51944,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:37709 req_id = 79f93862-f63b-4f74-9b67-c44ef02b8633
37972026-03-03T18:57:05.466ZDEBGtest_metrics (store): query key key = _dendrite._tcp
37982026-03-03T18:57:05.466ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
37992026-03-03T18:57:05.466ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:37709 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 79f93862-f63b-4f74-9b67-c44ef02b8633
38002026-03-03T18:57:05.466ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1962, tv_nsec: 730283920 } })
38012026-03-03T18:57:05.466ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
38022026-03-03T18:57:05.466ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: cc c5 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:45422 req_id = 3c0196db-754c-4d09-b6ee-2505a4b1d0db
38032026-03-03T18:57:05.466ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 52421,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:45422 req_id = 3c0196db-754c-4d09-b6ee-2505a4b1d0db
38042026-03-03T18:57:05.466ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
38052026-03-03T18:57:05.466ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:45422 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 3c0196db-754c-4d09-b6ee-2505a4b1d0db
38062026-03-03T18:57:05.466ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38072026-03-03T18:57:05.469ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
38082026-03-03T18:57:05.470ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
38092026-03-03T18:57:05.470ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38102026-03-03T18:57:05.470ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
38112026-03-03T18:57:05.470ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38122026-03-03T18:57:05.470ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
38132026-03-03T18:57:05.488ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:34679/switch/identifiers
38142026-03-03T18:57:05.489ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\n/* The measurement tables contain all individual samples from each timeseries.\n *\n * Each table stores a single datum type, and otherwise contains nearly the same\n * structure. The primary sorting key is on the timeseries name, key, and then\n * timestamp, so that all timeseries from the same schema are grouped, followed\n * by all samples from the same timeseries.\n *\n * This reflects that one usually looks up the _key_ in one or more field table,\n * and then uses that to index quickly into the measurements tables.\n */\nCREATE TABLE IF NOT EXISTS oximeter.measurements_bool\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Bool)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38152026-03-03T18:57:05.490ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38162026-03-03T18:57:05.493ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
38172026-03-03T18:57:05.493ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
38182026-03-03T18:57:05.493ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38192026-03-03T18:57:05.493ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
38202026-03-03T18:57:05.494ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:34679/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "56411142-71dd-4cce-b08a-1250f34c9d5e", "content-length": "206", "date": "Tue, 03 Mar 2026 18:57:05 GMT"} })
38212026-03-03T18:57:05.494ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
38222026-03-03T18:57:05.494ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
38232026-03-03T18:57:05.494ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
38242026-03-03T18:57:05.495ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
38252026-03-03T18:57:05.497ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
38262026-03-03T18:57:05.497ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38272026-03-03T18:57:05.497ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
38282026-03-03T18:57:05.497ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38292026-03-03T18:57:05.497ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
38302026-03-03T18:57:05.497ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
38312026-03-03T18:57:05.497ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
38322026-03-03T18:57:05.497ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
38332026-03-03T18:57:05.497ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
38342026-03-03T18:57:05.497ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
38352026-03-03T18:57:05.498ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i8\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int8)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38362026-03-03T18:57:05.499ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38372026-03-03T18:57:05.502ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
38382026-03-03T18:57:05.502ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
38392026-03-03T18:57:05.502ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38402026-03-03T18:57:05.502ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
38412026-03-03T18:57:05.502ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38422026-03-03T18:57:05.502ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
38432026-03-03T18:57:05.502ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
38442026-03-03T18:57:05.502ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
38452026-03-03T18:57:05.502ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
38462026-03-03T18:57:05.503ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
38472026-03-03T18:57:05.503ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
38482026-03-03T18:57:05.504ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38492026-03-03T18:57:05.507ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
38502026-03-03T18:57:05.507ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
38512026-03-03T18:57:05.507ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38522026-03-03T18:57:05.507ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
38532026-03-03T18:57:05.508ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u8\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt8)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38542026-03-03T18:57:05.509ZINFOtest_metrics (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous num_already_exist = 0 num_inserted = 0 num_not_in_inventory = 0
38552026-03-03T18:57:05.509ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
38562026-03-03T18:57:05.509ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38572026-03-03T18:57:05.509ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
38582026-03-03T18:57:05.509ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38592026-03-03T18:57:05.509ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
38602026-03-03T18:57:05.510ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38612026-03-03T18:57:05.514ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
38622026-03-03T18:57:05.514ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
38632026-03-03T18:57:05.514ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38642026-03-03T18:57:05.514ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
38652026-03-03T18:57:05.514ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38662026-03-03T18:57:05.514ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
38672026-03-03T18:57:05.522ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38682026-03-03T18:57:05.525ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
38692026-03-03T18:57:05.525ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
38702026-03-03T18:57:05.525ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38712026-03-03T18:57:05.525ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
38722026-03-03T18:57:05.527ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i16\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int16)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38732026-03-03T18:57:05.527ZINFOtest_metrics (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
38742026-03-03T18:57:05.527ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
38752026-03-03T18:57:05.527ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38762026-03-03T18:57:05.527ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
38772026-03-03T18:57:05.527ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38782026-03-03T18:57:05.528ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
38792026-03-03T18:57:05.529ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38802026-03-03T18:57:05.532ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
38812026-03-03T18:57:05.532ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
38822026-03-03T18:57:05.532ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38832026-03-03T18:57:05.532ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
38842026-03-03T18:57:05.532ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38852026-03-03T18:57:05.533ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
38862026-03-03T18:57:05.551ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38872026-03-03T18:57:05.554ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
38882026-03-03T18:57:05.554ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
38892026-03-03T18:57:05.554ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38902026-03-03T18:57:05.554ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
38912026-03-03T18:57:05.555ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
38922026-03-03T18:57:05.555ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
38932026-03-03T18:57:05.555ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
38942026-03-03T18:57:05.555ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
38952026-03-03T18:57:05.555ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
38962026-03-03T18:57:05.557ZINFOtest_metrics (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
38972026-03-03T18:57:05.559ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 93.929974ms iteration = 3 status = {"blueprint_id":"a34df21f-b47e-418a-ab97-8a520be16a04","inventory_collection_id":"7b3e1531-9e16-46a8-b395-70c01b6466c5","stats":{"crucible_dataset":{"num_already_exist":0,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
38982026-03-03T18:57:05.559ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
38992026-03-03T18:57:05.559ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
39002026-03-03T18:57:05.559ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
39012026-03-03T18:57:05.559ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
39022026-03-03T18:57:05.560ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u16\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt16)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39032026-03-03T18:57:05.572ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i32\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39042026-03-03T18:57:05.586ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
39052026-03-03T18:57:05.586ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
39062026-03-03T18:57:05.586ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
39072026-03-03T18:57:05.586ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
39082026-03-03T18:57:05.587ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
39092026-03-03T18:57:05.587ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u32\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39102026-03-03T18:57:05.604ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i64\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39112026-03-03T18:57:05.617ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u64\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39122026-03-03T18:57:05.623ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
39132026-03-03T18:57:05.623ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
39142026-03-03T18:57:05.624ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
39152026-03-03T18:57:05.624ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 161.924139ms iteration = 3 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
39162026-03-03T18:57:05.640ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_f32\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39172026-03-03T18:57:05.658ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_f64\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39182026-03-03T18:57:05.671ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_string\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(String)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39192026-03-03T18:57:05.687ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_bytes\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n /*\n * NOTE: Right now we can't unambiguously record a nullable byte array.\n * Arrays cannot be nested in `Nullable()` types, and encoding the array as\n * a string isn't palatable for a few reasons.\n * See: https://github.com/oxidecomputer/omicron/issues/4551 for more\n * details.\n */\n datum Array(UInt8)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39202026-03-03T18:57:05.701ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativei64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39212026-03-03T18:57:05.715ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativeu64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39222026-03-03T18:57:05.724ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39232026-03-03T18:57:05.737ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39242026-03-03T18:57:05.753ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n /*\n * NOTE: Array types cannot be Nullable, see\n * https://clickhouse.com/docs/en/sql-reference/data-types/nullable\n * for more details.\n *\n * This means we need to use empty arrays to indicate a missing value. This\n * is unfortunate, and at this point relies on the fact that an\n * `oximeter::Histogram` cannot have zero bins. If that changes, we'll need\n * to figure out another way to represent missing samples here.\n */\n bins Array(Int8),\n counts Array(UInt64),\n min Int8,\n max Int8,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39252026-03-03T18:57:05.767ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt8),\n counts Array(UInt64),\n min UInt8,\n max UInt8,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39262026-03-03T18:57:05.778ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Int16),\n counts Array(UInt64),\n min Int16,\n max Int16,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39272026-03-03T18:57:05.788ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt16),\n counts Array(UInt64),\n min UInt16,\n max UInt16,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39282026-03-03T18:57:05.796ZDEBGtest_metrics (producer-registration-task): will register with Nexus at 127.0.0.1:41339
39292026-03-03T18:57:05.805ZDEBGtest_metrics (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:41339/metrics/producers
39302026-03-03T18:57:05.806ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Int32),\n counts Array(UInt64),\n min Int32,\n max Int32,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39312026-03-03T18:57:05.807ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:41339 remote_addr = 127.0.0.1:36730
39322026-03-03T18:57:05.807ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36730 req_id = 32008eab-c151-41e6-9865-6e2bd53efca5 uri = /metrics/producers
39332026-03-03T18:57:05.807ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36730 req_id = 32008eab-c151-41e6-9865-6e2bd53efca5 uri = /metrics/producers version = 1.0.0
39342026-03-03T18:57:05.808ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36730 req_id = 32008eab-c151-41e6-9865-6e2bd53efca5 resource = Database type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
39352026-03-03T18:57:05.808ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36730 req_id = 32008eab-c151-41e6-9865-6e2bd53efca5 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
39362026-03-03T18:57:05.808ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36730 req_id = 32008eab-c151-41e6-9865-6e2bd53efca5 resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
39372026-03-03T18:57:05.813ZINFOtest_metrics (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no Oximeter instances available for assignment latency_us = 5154 local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36730 req_id = 32008eab-c151-41e6-9865-6e2bd53efca5 response_code = 503 uri = /metrics/producers
39382026-03-03T18:57:05.816ZDEBGtest_metrics (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "32008eab-c151-41e6-9865-6e2bd53efca5", "content-length": "133", "date": "Tue, 03 Mar 2026 18:57:05 GMT"} })
39392026-03-03T18:57:05.816ZWARNtest_metrics (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 429.578729ms error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "32008eab-c151-41e6-9865-6e2bd53efca5", "content-length": "133", "date": "Tue, 03 Mar 2026 18:57:05 GMT"}; value: Error { error_code: Some("ServiceNotAvailable"), message: "Service Unavailable", request_id: "32008eab-c151-41e6-9865-6e2bd53efca5" } file = oximeter/producer/src/lib.rs:377
39402026-03-03T18:57:05.816ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt32),\n counts Array(UInt64),\n min UInt32,\n max UInt32,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39412026-03-03T18:57:05.828ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Int64),\n counts Array(UInt64),\n min Int64,\n max Int64,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39422026-03-03T18:57:05.839ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt64),\n counts Array(UInt64),\n min UInt64,\n max UInt64,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39432026-03-03T18:57:05.847ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Float32),\n counts Array(UInt64),\n min Float32,\n max Float32,\n sum_of_samples Float64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39442026-03-03T18:57:05.859ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Float64),\n counts Array(UInt64),\n min Float64,\n max Float64,\n sum_of_samples Float64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
39452026-03-03T18:57:05.869ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\n/* The field tables store named dimensions of each timeseries.\n *\n * As with the measurement tables, there is one field table for each field data\n * type. Fields are deduplicated by using the "replacing merge tree", though\n * this behavior **must not** be relied upon for query correctness.\n *\n * The index for the fields differs from the measurements, however. Rows are\n * sorted by timeseries name, then field name, field value, and finally\n * timeseries key. This reflects the most common pattern for looking them up:\n * by field name and possibly value, within a timeseries. The resulting keys are\n * usually then used to look up measurements.\n *\n * NOTE: We may want to consider a secondary index on these tables, sorting by\n * timeseries name and then key, since it would improve lookups where one\n * already has the key. Realistically though, these tables are quite small and\n * so performance benefits will be low in absolute terms.\n *\n * TTL: We use a materialized column to expire old field table records. This\n * column is generated automatically by the database whenever a new row is\n * inserted. It cannot be inserted directly, nor is it returned in a `SELECT *`\n * query. Since these tables are `ReplacingMergeTree`s, that means the last\n * record will remain during a deduplication, which will have the last\n * timestamp. ClickHouse will then expire old data for us, similar to the\n * measurement tables.\n */\nCREATE TABLE IF NOT EXISTS oximeter.fields_bool\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Bool,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
39462026-03-03T18:57:05.879ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i8\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int8,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
39472026-03-03T18:57:05.893ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u8\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt8,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
39482026-03-03T18:57:05.913ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i16\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int16,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
39492026-03-03T18:57:05.924ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u16\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt16,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
39502026-03-03T18:57:05.936ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i32\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int32,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
39512026-03-03T18:57:05.948ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u32\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt32,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
39522026-03-03T18:57:05.961ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i64\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int64,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
39532026-03-03T18:57:05.971ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u64\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt64,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
39542026-03-03T18:57:05.990ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_ipaddr\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value IPv6,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
39552026-03-03T18:57:06.005ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_string\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value String,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
39562026-03-03T18:57:06.021ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_uuid\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UUID,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
39572026-03-03T18:57:06.033ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = \n\n/* The timeseries schema table stores the extracted schema for the samples\n * oximeter collects.\n */\nCREATE TABLE IF NOT EXISTS oximeter.timeseries_schema\n(\n timeseries_name String,\n fields Nested(\n name String,\n type Enum(\n 'Bool' = 1,\n 'I64' = 2,\n 'IpAddr' = 3,\n 'String' = 4,\n 'Uuid' = 6,\n 'I8' = 7,\n 'U8' = 8,\n 'I16' = 9,\n 'U16' = 10,\n 'I32' = 11,\n 'U32' = 12,\n 'U64' = 13\n ),\n source Enum(\n 'Target' = 1,\n 'Metric' = 2\n )\n ),\n datum_type Enum(\n 'Bool' = 1,\n 'I64' = 2,\n 'F64' = 3,\n 'String' = 4,\n 'Bytes' = 5,\n 'CumulativeI64' = 6,\n 'CumulativeF64' = 7,\n 'HistogramI64' = 8,\n 'HistogramF64' = 9,\n 'I8' = 10,\n 'U8' = 11,\n 'I16' = 12,\n 'U16' = 13,\n 'I32' = 14,\n 'U32' = 15,\n 'U64' = 16,\n 'F32' = 17,\n 'CumulativeU64' = 18,\n 'CumulativeF32' = 19,\n 'HistogramI8' = 20,\n 'HistogramU8' = 21,\n 'HistogramI16' = 22,\n 'HistogramU16' = 23,\n 'HistogramI32' = 24,\n 'HistogramU32' = 25,\n 'HistogramU64' = 26,\n 'HistogramF32' = 27\n ),\n created DateTime64(9, 'UTC')\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, fields.name)
39582026-03-03T18:57:06.045ZINFOtest_metrics (clickhouse-client): inserting current version collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:831 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af version = 14
39592026-03-03T18:57:06.045ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = INSERT INTO oximeter.version (*) VALUES (14, now());
39602026-03-03T18:57:06.053ZDEBGtest_metrics (clickhouse-client): registered USDT probes collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = a400581b-12bb-486d-9a26-86b6eedcde7a
39612026-03-03T18:57:06.054ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:41283 method = GET path = /info versions = all
39622026-03-03T18:57:06.065ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:41283 method = GET path = /producers versions = all
39632026-03-03T18:57:06.066ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:41283 method = DELETE path = /producers/{producer_id} versions = all
39642026-03-03T18:57:06.066ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:41283 method = GET path = /producers/{producer_id} versions = all
39652026-03-03T18:57:06.066ZINFOtest_metrics (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [::1]:41283
39662026-03-03T18:57:06.066ZDEBGtest_metrics (dropshot): successfully registered DTrace USDT probes local_addr = [::1]:41283
39672026-03-03T18:57:06.066ZDEBGtest_metrics (oximeter): registered USDT probes
39682026-03-03T18:57:06.066ZDEBGtest_metrics (oximeter): contacting nexus
39692026-03-03T18:57:06.137ZDEBGtest_metrics (oximeter): client request body = Some(Body) method = POST uri = http://127.0.0.1:41339/metrics/collectors
39702026-03-03T18:57:06.137ZDEBGtest_metrics (producer-registration-task): will register with Nexus at 127.0.0.1:41339
39712026-03-03T18:57:06.145ZDEBGtest_metrics (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:41339/metrics/producers
39722026-03-03T18:57:06.147ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:41339 remote_addr = 127.0.0.1:36732
39732026-03-03T18:57:06.147ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:41339 remote_addr = 127.0.0.1:36736
39742026-03-03T18:57:06.148ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36736 req_id = 3fddaf76-2938-4f83-8b80-52cf1c7ccf1b uri = /metrics/producers
39752026-03-03T18:57:06.148ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36736 req_id = 3fddaf76-2938-4f83-8b80-52cf1c7ccf1b uri = /metrics/producers version = 1.0.0
39762026-03-03T18:57:06.148ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36736 req_id = 3fddaf76-2938-4f83-8b80-52cf1c7ccf1b resource = Database type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
39772026-03-03T18:57:06.148ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36736 req_id = 3fddaf76-2938-4f83-8b80-52cf1c7ccf1b roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
39782026-03-03T18:57:06.149ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36736 req_id = 3fddaf76-2938-4f83-8b80-52cf1c7ccf1b resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
39792026-03-03T18:57:06.151ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36732 req_id = 0ef06919-7eed-4e5b-bbe7-56c9c267a93a uri = /metrics/collectors
39802026-03-03T18:57:06.151ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36732 req_id = 0ef06919-7eed-4e5b-bbe7-56c9c267a93a uri = /metrics/collectors version = 1.0.0
39812026-03-03T18:57:06.151ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36732 req_id = 0ef06919-7eed-4e5b-bbe7-56c9c267a93a resource = Database type = user_builtin uri = /metrics/collectors user_builtin_id = 001de000-05e4-4000-8000-000000000002
39822026-03-03T18:57:06.151ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36732 req_id = 0ef06919-7eed-4e5b-bbe7-56c9c267a93a roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors user_builtin_id = 001de000-05e4-4000-8000-000000000002
39832026-03-03T18:57:06.152ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36732 req_id = 0ef06919-7eed-4e5b-bbe7-56c9c267a93a resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors user_builtin_id = 001de000-05e4-4000-8000-000000000002
39842026-03-03T18:57:06.155ZINFOtest_metrics (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no Oximeter instances available for assignment latency_us = 7528 local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36736 req_id = 3fddaf76-2938-4f83-8b80-52cf1c7ccf1b response_code = 503 uri = /metrics/producers
39852026-03-03T18:57:06.156ZDEBGtest_metrics (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "3fddaf76-2938-4f83-8b80-52cf1c7ccf1b", "content-length": "133", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
39862026-03-03T18:57:06.156ZWARNtest_metrics (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 772.432706ms error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "3fddaf76-2938-4f83-8b80-52cf1c7ccf1b", "content-length": "133", "date": "Tue, 03 Mar 2026 18:57:06 GMT"}; value: Error { error_code: Some("ServiceNotAvailable"), message: "Service Unavailable", request_id: "3fddaf76-2938-4f83-8b80-52cf1c7ccf1b" } file = oximeter/producer/src/lib.rs:377
39872026-03-03T18:57:06.157ZINFOtest_metrics (nexus): registered new oximeter metric collection server address = [::1]:41283 collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78
39882026-03-03T18:57:06.157ZINFOtest_metrics (dropshot_internal): request completed latency_us = 6499 local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36732 req_id = 0ef06919-7eed-4e5b-bbe7-56c9c267a93a response_code = 204 uri = /metrics/collectors
39892026-03-03T18:57:06.157ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/collectors", status: 204, headers: {"x-request-id": "0ef06919-7eed-4e5b-bbe7-56c9c267a93a", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
39902026-03-03T18:57:06.157ZINFOtest_metrics (oximeter): oximeter registered with nexus file = oximeter/collector/src/lib.rs:427 id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78
39912026-03-03T18:57:06.158ZDEBGtest_metrics (init_with_steps): Running step start_producer_server
39922026-03-03T18:57:06.158ZDEBGtest_metrics: Starting test metric Producer Server
39932026-03-03T18:57:06.158ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:37769/v1/system/ip-pools
39942026-03-03T18:57:06.158ZINFOtest_metrics (oximeter-agent): starting refresh list task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:554
39952026-03-03T18:57:06.167ZINFOtest_metrics (dropshot_external): accepted connection local_addr = 127.0.0.1:37769 remote_addr = 127.0.0.1:50678
39962026-03-03T18:57:06.167ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:41339 remote_addr = 127.0.0.1:36738
39972026-03-03T18:57:06.168ZINFOtest_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
39982026-03-03T18:57:06.168ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
39992026-03-03T18:57:06.168ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36738 req_id = 43b633af-c2cd-49ad-afee-4197c97a3336 uri = /metrics/producers
40002026-03-03T18:57:06.168ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36738 req_id = 43b633af-c2cd-49ad-afee-4197c97a3336 uri = /metrics/producers version = 1.0.0
40012026-03-03T18:57:06.168ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 0a1e45b9-12fe-49c3-8d06-3ae2170e175f uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
40022026-03-03T18:57:06.168ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 0a1e45b9-12fe-49c3-8d06-3ae2170e175f uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
40032026-03-03T18:57:06.169ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36738 req_id = 43b633af-c2cd-49ad-afee-4197c97a3336 resource = Database type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
40042026-03-03T18:57:06.169ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36738 req_id = 43b633af-c2cd-49ad-afee-4197c97a3336 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
40052026-03-03T18:57:06.169ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36738 req_id = 43b633af-c2cd-49ad-afee-4197c97a3336 resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
40062026-03-03T18:57:06.170ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 0a1e45b9-12fe-49c3-8d06-3ae2170e175f resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
40072026-03-03T18:57:06.170ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 0a1e45b9-12fe-49c3-8d06-3ae2170e175f roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
40082026-03-03T18:57:06.171ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 0a1e45b9-12fe-49c3-8d06-3ae2170e175f resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
40092026-03-03T18:57:06.171ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 uri = /v1/system/ip-pools
40102026-03-03T18:57:06.171ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 uri = /v1/system/ip-pools version = 2026021900.0.0
40112026-03-03T18:57:06.172ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 uri = /v1/system/ip-pools
40122026-03-03T18:57:06.172ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools
40132026-03-03T18:57:06.172ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40142026-03-03T18:57:06.172ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40152026-03-03T18:57:06.172ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40162026-03-03T18:57:06.175ZINFOtest_metrics (dropshot_internal): request completed latency_us = 6165 local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 0a1e45b9-12fe-49c3-8d06-3ae2170e175f response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
40172026-03-03T18:57:06.175ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a1e45b9-12fe-49c3-8d06-3ae2170e175f", "content-length": "29", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
40182026-03-03T18:57:06.175ZINFOtest_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 0 n_pruned_tasks = 0
40192026-03-03T18:57:06.175ZINFOtest_metrics (nexus): assigned collector to new producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
40202026-03-03T18:57:06.175ZINFOtest_metrics (dropshot_internal): request completed latency_us = 6970 local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36738 req_id = 43b633af-c2cd-49ad-afee-4197c97a3336 response_code = 201 uri = /metrics/producers
40212026-03-03T18:57:06.175ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40222026-03-03T18:57:06.175ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40232026-03-03T18:57:06.176ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40242026-03-03T18:57:06.177ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
40252026-03-03T18:57:06.177ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
40262026-03-03T18:57:06.177ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40272026-03-03T18:57:06.177ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40282026-03-03T18:57:06.178ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40292026-03-03T18:57:06.184ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
40302026-03-03T18:57:06.184ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40312026-03-03T18:57:06.184ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40322026-03-03T18:57:06.184ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40332026-03-03T18:57:06.187ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40342026-03-03T18:57:06.189ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
40352026-03-03T18:57:06.189ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40362026-03-03T18:57:06.189ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40372026-03-03T18:57:06.189ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40382026-03-03T18:57:06.192ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
40392026-03-03T18:57:06.192ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
40402026-03-03T18:57:06.192ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40412026-03-03T18:57:06.192ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40422026-03-03T18:57:06.192ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40432026-03-03T18:57:06.193ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
40442026-03-03T18:57:06.193ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40452026-03-03T18:57:06.193ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40462026-03-03T18:57:06.194ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40472026-03-03T18:57:06.206ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40482026-03-03T18:57:06.211ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
40492026-03-03T18:57:06.211ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 uri = /v1/system/ip-pools
40502026-03-03T18:57:06.211ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40512026-03-03T18:57:06.211ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40522026-03-03T18:57:06.211ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40532026-03-03T18:57:06.211ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40542026-03-03T18:57:06.211ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40552026-03-03T18:57:06.212ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40562026-03-03T18:57:06.214ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40572026-03-03T18:57:06.215ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40582026-03-03T18:57:06.215ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40592026-03-03T18:57:06.215ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40602026-03-03T18:57:06.274ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = IpPoolList silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40612026-03-03T18:57:06.274ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40622026-03-03T18:57:06.274ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40632026-03-03T18:57:06.274ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40642026-03-03T18:57:06.275ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40652026-03-03T18:57:06.278ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40662026-03-03T18:57:06.283ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = IpPoolList result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40672026-03-03T18:57:06.283ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40682026-03-03T18:57:06.283ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40692026-03-03T18:57:06.283ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40702026-03-03T18:57:06.365ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40712026-03-03T18:57:06.365ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40722026-03-03T18:57:06.365ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40732026-03-03T18:57:06.365ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40742026-03-03T18:57:06.365ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40752026-03-03T18:57:06.368ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40762026-03-03T18:57:06.369ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40772026-03-03T18:57:06.369ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40782026-03-03T18:57:06.369ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40792026-03-03T18:57:06.370ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40802026-03-03T18:57:06.400ZINFOtest_metrics (dropshot_external): request completed latency_us = 228851 local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 36244415-4005-4a0f-9f87-8c1f1b1bde39 response_code = 201 uri = /v1/system/ip-pools
40812026-03-03T18:57:06.400ZINFOtest_metrics (external client test context): client received response status = 201
40822026-03-03T18:57:06.401ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:37769/v1/system/ip-pools/default-v4/ranges/add
40832026-03-03T18:57:06.401ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 uri = /v1/system/ip-pools/default-v4/ranges/add
40842026-03-03T18:57:06.401ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 uri = /v1/system/ip-pools/default-v4/ranges/add version = 2026021900.0.0
40852026-03-03T18:57:06.401ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 uri = /v1/system/ip-pools/default-v4/ranges/add
40862026-03-03T18:57:06.401ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools/default-v4/ranges/add
40872026-03-03T18:57:06.401ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40882026-03-03T18:57:06.401ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40892026-03-03T18:57:06.402ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40902026-03-03T18:57:06.403ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40912026-03-03T18:57:06.403ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40922026-03-03T18:57:06.404ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40932026-03-03T18:57:06.409ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
40942026-03-03T18:57:06.409ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
40952026-03-03T18:57:06.409ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40962026-03-03T18:57:06.409ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40972026-03-03T18:57:06.409ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40982026-03-03T18:57:06.411ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
40992026-03-03T18:57:06.411ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41002026-03-03T18:57:06.411ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41012026-03-03T18:57:06.411ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41022026-03-03T18:57:06.412ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41032026-03-03T18:57:06.415ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
41042026-03-03T18:57:06.415ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41052026-03-03T18:57:06.415ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41062026-03-03T18:57:06.415ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41072026-03-03T18:57:06.416ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
41082026-03-03T18:57:06.416ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
41092026-03-03T18:57:06.416ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41102026-03-03T18:57:06.416ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41112026-03-03T18:57:06.417ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41122026-03-03T18:57:06.418ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
41132026-03-03T18:57:06.418ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41142026-03-03T18:57:06.418ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41152026-03-03T18:57:06.418ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41162026-03-03T18:57:06.420ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41172026-03-03T18:57:06.422ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
41182026-03-03T18:57:06.422ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 uri = /v1/system/ip-pools/default-v4/ranges/add
41192026-03-03T18:57:06.422ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41202026-03-03T18:57:06.422ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41212026-03-03T18:57:06.422ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41222026-03-03T18:57:06.422ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41232026-03-03T18:57:06.422ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41242026-03-03T18:57:06.426ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41252026-03-03T18:57:06.428ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41262026-03-03T18:57:06.428ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41272026-03-03T18:57:06.428ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41282026-03-03T18:57:06.428ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41292026-03-03T18:57:06.431ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41302026-03-03T18:57:06.431ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41312026-03-03T18:57:06.431ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41322026-03-03T18:57:06.431ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = IpPool { parent: Fleet, key: 9d951970-7f85-40d6-af9b-6bd5bc1c99c5, lookup_type: ByName("default-v4") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41332026-03-03T18:57:06.432ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41342026-03-03T18:57:06.432ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41352026-03-03T18:57:06.432ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41362026-03-03T18:57:06.432ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41372026-03-03T18:57:06.434ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41382026-03-03T18:57:06.437ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = IpPool { parent: Fleet, key: 9d951970-7f85-40d6-af9b-6bd5bc1c99c5, lookup_type: ByName("default-v4") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41392026-03-03T18:57:06.437ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41402026-03-03T18:57:06.437ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41412026-03-03T18:57:06.437ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41422026-03-03T18:57:06.439ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41432026-03-03T18:57:06.439ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41442026-03-03T18:57:06.439ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41452026-03-03T18:57:06.439ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = IpPool { parent: Fleet, key: 9d951970-7f85-40d6-af9b-6bd5bc1c99c5, lookup_type: ByName("default-v4") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41462026-03-03T18:57:06.439ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41472026-03-03T18:57:06.440ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41482026-03-03T18:57:06.440ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41492026-03-03T18:57:06.440ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41502026-03-03T18:57:06.442ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41512026-03-03T18:57:06.443ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = IpPool { parent: Fleet, key: 9d951970-7f85-40d6-af9b-6bd5bc1c99c5, lookup_type: ByName("default-v4") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41522026-03-03T18:57:06.448ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41532026-03-03T18:57:06.448ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41542026-03-03T18:57:06.448ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41552026-03-03T18:57:06.448ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41562026-03-03T18:57:06.449ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41572026-03-03T18:57:06.453ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41582026-03-03T18:57:06.455ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41592026-03-03T18:57:06.456ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41602026-03-03T18:57:06.456ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41612026-03-03T18:57:06.456ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
41622026-03-03T18:57:06.458ZINFOtest_metrics (dropshot_external): request completed latency_us = 57577 local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 160353da-60f0-4b83-ae45-e2a9a41ba465 response_code = 201 uri = /v1/system/ip-pools/default-v4/ranges/add
41632026-03-03T18:57:06.459ZINFOtest_metrics (external client test context): client received response status = 201
41642026-03-03T18:57:06.459ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:37769/v1/system/ip-pools/default-v4/silos
41652026-03-03T18:57:06.459ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 uri = /v1/system/ip-pools/default-v4/silos
41662026-03-03T18:57:06.459ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 uri = /v1/system/ip-pools/default-v4/silos version = 2026021900.0.0
41672026-03-03T18:57:06.459ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 uri = /v1/system/ip-pools/default-v4/silos
41682026-03-03T18:57:06.460ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools/default-v4/silos
41692026-03-03T18:57:06.460ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41702026-03-03T18:57:06.460ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41712026-03-03T18:57:06.460ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41722026-03-03T18:57:06.461ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41732026-03-03T18:57:06.461ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41742026-03-03T18:57:06.462ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41752026-03-03T18:57:06.463ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
41762026-03-03T18:57:06.463ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
41772026-03-03T18:57:06.463ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41782026-03-03T18:57:06.463ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41792026-03-03T18:57:06.463ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41802026-03-03T18:57:06.465ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
41812026-03-03T18:57:06.465ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41822026-03-03T18:57:06.465ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41832026-03-03T18:57:06.465ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41842026-03-03T18:57:06.466ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41852026-03-03T18:57:06.468ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
41862026-03-03T18:57:06.468ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41872026-03-03T18:57:06.469ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41882026-03-03T18:57:06.469ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41892026-03-03T18:57:06.470ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
41902026-03-03T18:57:06.470ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
41912026-03-03T18:57:06.470ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41922026-03-03T18:57:06.470ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41932026-03-03T18:57:06.470ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41942026-03-03T18:57:06.471ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
41952026-03-03T18:57:06.472ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41962026-03-03T18:57:06.472ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41972026-03-03T18:57:06.472ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41982026-03-03T18:57:06.478ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41992026-03-03T18:57:06.478ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
42002026-03-03T18:57:06.478ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 uri = /v1/system/ip-pools/default-v4/silos
42012026-03-03T18:57:06.479ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42022026-03-03T18:57:06.479ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42032026-03-03T18:57:06.479ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42042026-03-03T18:57:06.479ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42052026-03-03T18:57:06.479ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42062026-03-03T18:57:06.480ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42072026-03-03T18:57:06.481ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42082026-03-03T18:57:06.481ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42092026-03-03T18:57:06.482ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42102026-03-03T18:57:06.482ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42112026-03-03T18:57:06.494ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42122026-03-03T18:57:06.494ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42132026-03-03T18:57:06.494ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42142026-03-03T18:57:06.496ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = IpPool { parent: Fleet, key: 9d951970-7f85-40d6-af9b-6bd5bc1c99c5, lookup_type: ByName("default-v4") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42152026-03-03T18:57:06.496ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42162026-03-03T18:57:06.496ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42172026-03-03T18:57:06.496ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42182026-03-03T18:57:06.496ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42192026-03-03T18:57:06.498ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42202026-03-03T18:57:06.501ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = IpPool { parent: Fleet, key: 9d951970-7f85-40d6-af9b-6bd5bc1c99c5, lookup_type: ByName("default-v4") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42212026-03-03T18:57:06.501ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42222026-03-03T18:57:06.501ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42232026-03-03T18:57:06.501ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42242026-03-03T18:57:06.502ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42252026-03-03T18:57:06.502ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42262026-03-03T18:57:06.503ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42272026-03-03T18:57:06.504ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42282026-03-03T18:57:06.504ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42292026-03-03T18:57:06.504ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42302026-03-03T18:57:06.504ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42312026-03-03T18:57:06.504ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42322026-03-03T18:57:06.506ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42332026-03-03T18:57:06.506ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42342026-03-03T18:57:06.506ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42352026-03-03T18:57:06.506ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42362026-03-03T18:57:06.508ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42372026-03-03T18:57:06.509ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42382026-03-03T18:57:06.509ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = IpPoolList silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42392026-03-03T18:57:06.509ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42402026-03-03T18:57:06.509ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42412026-03-03T18:57:06.509ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42422026-03-03T18:57:06.510ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42432026-03-03T18:57:06.511ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42442026-03-03T18:57:06.514ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = IpPoolList result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42452026-03-03T18:57:06.514ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42462026-03-03T18:57:06.514ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42472026-03-03T18:57:06.515ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42482026-03-03T18:57:06.545ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42492026-03-03T18:57:06.546ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42502026-03-03T18:57:06.546ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42512026-03-03T18:57:06.546ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42522026-03-03T18:57:06.546ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42532026-03-03T18:57:06.548ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42542026-03-03T18:57:06.549ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42552026-03-03T18:57:06.550ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42562026-03-03T18:57:06.550ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42572026-03-03T18:57:06.550ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
42582026-03-03T18:57:06.551ZINFOtest_metrics (dropshot_external): request completed latency_us = 92070 local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d9d0645a-fef7-44f6-aad1-26a45fc33ac7 response_code = 201 uri = /v1/system/ip-pools/default-v4/silos
42592026-03-03T18:57:06.552ZINFOtest_metrics (external client test context): client received response status = 201
42602026-03-03T18:57:06.552ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:37769/v1/system/ip-pools
42612026-03-03T18:57:06.553ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c uri = /v1/system/ip-pools
42622026-03-03T18:57:06.553ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c uri = /v1/system/ip-pools version = 2026021900.0.0
42632026-03-03T18:57:06.553ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c uri = /v1/system/ip-pools
42642026-03-03T18:57:06.553ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools
42652026-03-03T18:57:06.553ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42662026-03-03T18:57:06.553ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42672026-03-03T18:57:06.553ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42682026-03-03T18:57:06.554ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42692026-03-03T18:57:06.554ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42702026-03-03T18:57:06.555ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42712026-03-03T18:57:06.556ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
42722026-03-03T18:57:06.556ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
42732026-03-03T18:57:06.556ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42742026-03-03T18:57:06.556ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42752026-03-03T18:57:06.556ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42762026-03-03T18:57:06.557ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
42772026-03-03T18:57:06.557ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42782026-03-03T18:57:06.557ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42792026-03-03T18:57:06.558ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42802026-03-03T18:57:06.559ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42812026-03-03T18:57:06.561ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
42822026-03-03T18:57:06.561ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42832026-03-03T18:57:06.561ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42842026-03-03T18:57:06.561ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42852026-03-03T18:57:06.562ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
42862026-03-03T18:57:06.562ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
42872026-03-03T18:57:06.562ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42882026-03-03T18:57:06.562ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42892026-03-03T18:57:06.563ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42902026-03-03T18:57:06.564ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
42912026-03-03T18:57:06.564ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42922026-03-03T18:57:06.564ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42932026-03-03T18:57:06.564ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42942026-03-03T18:57:06.565ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42952026-03-03T18:57:06.567ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
42962026-03-03T18:57:06.567ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c uri = /v1/system/ip-pools
42972026-03-03T18:57:06.567ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42982026-03-03T18:57:06.567ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42992026-03-03T18:57:06.567ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43002026-03-03T18:57:06.567ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43012026-03-03T18:57:06.568ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43022026-03-03T18:57:06.569ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43032026-03-03T18:57:06.571ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43042026-03-03T18:57:06.571ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43052026-03-03T18:57:06.571ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43062026-03-03T18:57:06.571ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43072026-03-03T18:57:06.572ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = IpPoolList silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43082026-03-03T18:57:06.572ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43092026-03-03T18:57:06.572ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43102026-03-03T18:57:06.572ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43112026-03-03T18:57:06.573ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43122026-03-03T18:57:06.574ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43132026-03-03T18:57:06.577ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = IpPoolList result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43142026-03-03T18:57:06.577ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43152026-03-03T18:57:06.577ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43162026-03-03T18:57:06.577ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43172026-03-03T18:57:06.579ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43182026-03-03T18:57:06.579ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43192026-03-03T18:57:06.579ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43202026-03-03T18:57:06.579ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43212026-03-03T18:57:06.579ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43222026-03-03T18:57:06.581ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43232026-03-03T18:57:06.582ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43242026-03-03T18:57:06.582ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43252026-03-03T18:57:06.582ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43262026-03-03T18:57:06.583ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
43272026-03-03T18:57:06.584ZINFOtest_metrics (dropshot_external): request completed latency_us = 32124 local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = a39cd714-ce71-435f-b9f6-1629be71207c response_code = 201 uri = /v1/system/ip-pools
43282026-03-03T18:57:06.584ZINFOtest_metrics (external client test context): client received response status = 201
43292026-03-03T18:57:06.585ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:37769/v1/system/ip-pools/default-v6/ranges/add
43302026-03-03T18:57:06.585ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 uri = /v1/system/ip-pools/default-v6/ranges/add
43312026-03-03T18:57:06.585ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 uri = /v1/system/ip-pools/default-v6/ranges/add version = 2026021900.0.0
43322026-03-03T18:57:06.585ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 uri = /v1/system/ip-pools/default-v6/ranges/add
43332026-03-03T18:57:06.585ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools/default-v6/ranges/add
43342026-03-03T18:57:06.585ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43352026-03-03T18:57:06.585ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43362026-03-03T18:57:06.586ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43372026-03-03T18:57:06.587ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43382026-03-03T18:57:06.587ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43392026-03-03T18:57:06.587ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43402026-03-03T18:57:06.588ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
43412026-03-03T18:57:06.588ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
43422026-03-03T18:57:06.588ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43432026-03-03T18:57:06.588ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43442026-03-03T18:57:06.589ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43452026-03-03T18:57:06.590ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
43462026-03-03T18:57:06.590ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43472026-03-03T18:57:06.590ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43482026-03-03T18:57:06.590ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43492026-03-03T18:57:06.591ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
43502026-03-03T18:57:06.593ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
43512026-03-03T18:57:06.593ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43522026-03-03T18:57:06.593ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43532026-03-03T18:57:06.594ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43542026-03-03T18:57:06.595ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
43552026-03-03T18:57:06.595ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
43562026-03-03T18:57:06.595ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43572026-03-03T18:57:06.595ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43582026-03-03T18:57:06.595ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43592026-03-03T18:57:06.596ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
43602026-03-03T18:57:06.596ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43612026-03-03T18:57:06.596ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43622026-03-03T18:57:06.597ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43632026-03-03T18:57:06.598ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
43642026-03-03T18:57:06.600ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
43652026-03-03T18:57:06.600ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 uri = /v1/system/ip-pools/default-v6/ranges/add
43662026-03-03T18:57:06.600ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43672026-03-03T18:57:06.600ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43682026-03-03T18:57:06.600ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43692026-03-03T18:57:06.600ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43702026-03-03T18:57:06.600ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43712026-03-03T18:57:06.601ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43722026-03-03T18:57:06.603ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43732026-03-03T18:57:06.603ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43742026-03-03T18:57:06.603ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43752026-03-03T18:57:06.603ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43762026-03-03T18:57:06.605ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43772026-03-03T18:57:06.605ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43782026-03-03T18:57:06.605ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43792026-03-03T18:57:06.606ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = IpPool { parent: Fleet, key: 022314ba-fc17-4b53-9d6f-88e2aeb59bd5, lookup_type: ByName("default-v6") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43802026-03-03T18:57:06.606ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43812026-03-03T18:57:06.606ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43822026-03-03T18:57:06.606ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43832026-03-03T18:57:06.607ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43842026-03-03T18:57:06.608ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43852026-03-03T18:57:06.611ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = IpPool { parent: Fleet, key: 022314ba-fc17-4b53-9d6f-88e2aeb59bd5, lookup_type: ByName("default-v6") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43862026-03-03T18:57:06.611ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43872026-03-03T18:57:06.611ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43882026-03-03T18:57:06.611ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43892026-03-03T18:57:06.612ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43902026-03-03T18:57:06.612ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43912026-03-03T18:57:06.613ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43922026-03-03T18:57:06.613ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = IpPool { parent: Fleet, key: 022314ba-fc17-4b53-9d6f-88e2aeb59bd5, lookup_type: ByName("default-v6") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43932026-03-03T18:57:06.613ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43942026-03-03T18:57:06.613ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43952026-03-03T18:57:06.613ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43962026-03-03T18:57:06.614ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43972026-03-03T18:57:06.615ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43982026-03-03T18:57:06.616ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = IpPool { parent: Fleet, key: 022314ba-fc17-4b53-9d6f-88e2aeb59bd5, lookup_type: ByName("default-v6") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43992026-03-03T18:57:06.621ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
44002026-03-03T18:57:06.621ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
44012026-03-03T18:57:06.621ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
44022026-03-03T18:57:06.621ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
44032026-03-03T18:57:06.622ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
44042026-03-03T18:57:06.623ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
44052026-03-03T18:57:06.625ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
44062026-03-03T18:57:06.625ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
44072026-03-03T18:57:06.625ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
44082026-03-03T18:57:06.625ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
44092026-03-03T18:57:06.627ZINFOtest_metrics (dropshot_external): request completed latency_us = 41863 local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 24da5acb-63f1-4f2f-aee8-7a87b63cf0e3 response_code = 201 uri = /v1/system/ip-pools/default-v6/ranges/add
44102026-03-03T18:57:06.627ZINFOtest_metrics (external client test context): client received response status = 201
44112026-03-03T18:57:06.627ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:37769/v1/system/ip-pools/default-v6/silos
44122026-03-03T18:57:06.628ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe uri = /v1/system/ip-pools/default-v6/silos
44132026-03-03T18:57:06.628ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe uri = /v1/system/ip-pools/default-v6/silos version = 2026021900.0.0
44142026-03-03T18:57:06.628ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe uri = /v1/system/ip-pools/default-v6/silos
44152026-03-03T18:57:06.628ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools/default-v6/silos
44162026-03-03T18:57:06.628ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44172026-03-03T18:57:06.628ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44182026-03-03T18:57:06.628ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44192026-03-03T18:57:06.629ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44202026-03-03T18:57:06.629ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44212026-03-03T18:57:06.630ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44222026-03-03T18:57:06.631ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
44232026-03-03T18:57:06.631ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
44242026-03-03T18:57:06.631ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44252026-03-03T18:57:06.631ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44262026-03-03T18:57:06.631ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44272026-03-03T18:57:06.632ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
44282026-03-03T18:57:06.632ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44292026-03-03T18:57:06.632ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44302026-03-03T18:57:06.633ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44312026-03-03T18:57:06.634ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
44322026-03-03T18:57:06.636ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
44332026-03-03T18:57:06.636ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44342026-03-03T18:57:06.636ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44352026-03-03T18:57:06.636ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44362026-03-03T18:57:06.637ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
44372026-03-03T18:57:06.637ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
44382026-03-03T18:57:06.637ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44392026-03-03T18:57:06.637ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44402026-03-03T18:57:06.638ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44412026-03-03T18:57:06.639ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
44422026-03-03T18:57:06.639ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44432026-03-03T18:57:06.639ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44442026-03-03T18:57:06.639ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44452026-03-03T18:57:06.640ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
44462026-03-03T18:57:06.642ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
44472026-03-03T18:57:06.642ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe uri = /v1/system/ip-pools/default-v6/silos
44482026-03-03T18:57:06.642ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44492026-03-03T18:57:06.642ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44502026-03-03T18:57:06.642ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44512026-03-03T18:57:06.642ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44522026-03-03T18:57:06.642ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44532026-03-03T18:57:06.644ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44542026-03-03T18:57:06.645ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44552026-03-03T18:57:06.645ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44562026-03-03T18:57:06.645ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44572026-03-03T18:57:06.645ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44582026-03-03T18:57:06.653ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44592026-03-03T18:57:06.653ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44602026-03-03T18:57:06.653ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44612026-03-03T18:57:06.655ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = IpPool { parent: Fleet, key: 022314ba-fc17-4b53-9d6f-88e2aeb59bd5, lookup_type: ByName("default-v6") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44622026-03-03T18:57:06.655ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44632026-03-03T18:57:06.655ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44642026-03-03T18:57:06.655ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44652026-03-03T18:57:06.655ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44662026-03-03T18:57:06.657ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44672026-03-03T18:57:06.660ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = IpPool { parent: Fleet, key: 022314ba-fc17-4b53-9d6f-88e2aeb59bd5, lookup_type: ByName("default-v6") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44682026-03-03T18:57:06.660ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44692026-03-03T18:57:06.660ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44702026-03-03T18:57:06.660ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44712026-03-03T18:57:06.661ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44722026-03-03T18:57:06.661ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44732026-03-03T18:57:06.662ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44742026-03-03T18:57:06.663ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44752026-03-03T18:57:06.663ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44762026-03-03T18:57:06.663ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44772026-03-03T18:57:06.663ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44782026-03-03T18:57:06.663ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44792026-03-03T18:57:06.665ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44802026-03-03T18:57:06.665ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44812026-03-03T18:57:06.665ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44822026-03-03T18:57:06.665ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44832026-03-03T18:57:06.666ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44842026-03-03T18:57:06.668ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44852026-03-03T18:57:06.668ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = IpPoolList silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44862026-03-03T18:57:06.668ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44872026-03-03T18:57:06.668ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44882026-03-03T18:57:06.668ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44892026-03-03T18:57:06.669ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44902026-03-03T18:57:06.670ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44912026-03-03T18:57:06.673ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = IpPoolList result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44922026-03-03T18:57:06.673ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44932026-03-03T18:57:06.673ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44942026-03-03T18:57:06.673ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44952026-03-03T18:57:06.676ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44962026-03-03T18:57:06.676ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44972026-03-03T18:57:06.676ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44982026-03-03T18:57:06.676ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44992026-03-03T18:57:06.676ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
45002026-03-03T18:57:06.678ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
45012026-03-03T18:57:06.679ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
45022026-03-03T18:57:06.679ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
45032026-03-03T18:57:06.679ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
45042026-03-03T18:57:06.679ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
45052026-03-03T18:57:06.681ZINFOtest_metrics (dropshot_external): request completed latency_us = 53619 local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ab9cb265-efce-4b58-adfb-220a4f5963fe response_code = 201 uri = /v1/system/ip-pools/default-v6/silos
45062026-03-03T18:57:06.682ZINFOtest_metrics (external client test context): client received response status = 201
45072026-03-03T18:57:06.682ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:45597 method = GET path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45082026-03-03T18:57:06.682ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:45597 method = POST path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45092026-03-03T18:57:06.682ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:45597 method = DELETE path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45102026-03-03T18:57:06.682ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:45597 method = GET path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45112026-03-03T18:57:06.682ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:45597 method = GET path = /crucible/0/regions/{id}/snapshots server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45122026-03-03T18:57:06.682ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:45597 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45132026-03-03T18:57:06.682ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:45597 method = GET path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45142026-03-03T18:57:06.682ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:45597 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45152026-03-03T18:57:06.682ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:45597 method = POST path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45162026-03-03T18:57:06.682ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): listening kind = storage local_addr = [::1]:45597 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
45172026-03-03T18:57:06.682ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): successfully registered DTrace USDT probes kind = storage local_addr = [::1]:45597 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
45182026-03-03T18:57:06.682ZINFOtest_metrics (SledAgent): Created Simulated Crucible Server address = [::1]:45597 kind = storage server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
45192026-03-03T18:57:06.682ZINFOtest_metrics (nexus): inserting test physical disk model = test-model physical_disk_id = 21d6ff64-b63b-4817-b92c-0db551ff2796 serial = totally-unique-serial: 21d6ff64-b63b-4817-b92c-0db551ff2796 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
45202026-03-03T18:57:06.682ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45212026-03-03T18:57:06.682ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45222026-03-03T18:57:06.683ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45232026-03-03T18:57:06.684ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45242026-03-03T18:57:06.684ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45252026-03-03T18:57:06.685ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45262026-03-03T18:57:06.685ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
45272026-03-03T18:57:06.685ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
45282026-03-03T18:57:06.685ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45292026-03-03T18:57:06.685ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45302026-03-03T18:57:06.686ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45312026-03-03T18:57:06.687ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45322026-03-03T18:57:06.689ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
45332026-03-03T18:57:06.768ZINFOtest_metrics (nexus): upserting zpool physical_disk_id = 21d6ff64-b63b-4817-b92c-0db551ff2796 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = 89c5eff8-6d6c-4e5d-af23-e1e997d2ec42
45342026-03-03T18:57:06.768ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45352026-03-03T18:57:06.768ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45362026-03-03T18:57:06.768ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45372026-03-03T18:57:06.769ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
45382026-03-03T18:57:06.769ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
45392026-03-03T18:57:06.769ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45402026-03-03T18:57:06.769ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45412026-03-03T18:57:06.770ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45422026-03-03T18:57:06.774ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45432026-03-03T18:57:06.777ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
45442026-03-03T18:57:06.781ZINFOtest_metrics (nexus): upserting Crucible dataset dataset_id = e9d1f98f-6ec0-4943-9557-bf2fa89209f0 zpool_id = 89c5eff8-6d6c-4e5d-af23-e1e997d2ec42
45452026-03-03T18:57:06.794ZINFOtest_metrics (nexus): inserting test physical disk model = test-model physical_disk_id = 21d6ff64-b63b-4817-b92c-0db551ff2796 serial = totally-unique-serial: 21d6ff64-b63b-4817-b92c-0db551ff2796 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
45462026-03-03T18:57:06.794ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45472026-03-03T18:57:06.794ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45482026-03-03T18:57:06.794ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45492026-03-03T18:57:06.795ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = PhysicalDisk { parent: Fleet, key: 21d6ff64-b63b-4817-b92c-0db551ff2796 (physical_disk), lookup_type: ById(21d6ff64-b63b-4817-b92c-0db551ff2796) }
45502026-03-03T18:57:06.795ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
45512026-03-03T18:57:06.795ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45522026-03-03T18:57:06.795ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45532026-03-03T18:57:06.795ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45542026-03-03T18:57:06.795ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45552026-03-03T18:57:06.798ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = PhysicalDisk { parent: Fleet, key: 21d6ff64-b63b-4817-b92c-0db551ff2796 (physical_disk), lookup_type: ById(21d6ff64-b63b-4817-b92c-0db551ff2796) } result = Ok(())
45562026-03-03T18:57:06.798ZINFOtest_metrics (nexus): upserting zpool physical_disk_id = 21d6ff64-b63b-4817-b92c-0db551ff2796 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = 89c5eff8-6d6c-4e5d-af23-e1e997d2ec42
45572026-03-03T18:57:06.798ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45582026-03-03T18:57:06.798ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45592026-03-03T18:57:06.798ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45602026-03-03T18:57:06.799ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
45612026-03-03T18:57:06.799ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
45622026-03-03T18:57:06.799ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45632026-03-03T18:57:06.799ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45642026-03-03T18:57:06.800ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45652026-03-03T18:57:06.803ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45662026-03-03T18:57:06.818ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
45672026-03-03T18:57:06.822ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
45682026-03-03T18:57:06.822ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
45692026-03-03T18:57:06.822ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45702026-03-03T18:57:06.822ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45712026-03-03T18:57:06.822ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45722026-03-03T18:57:06.824ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45732026-03-03T18:57:06.827ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
45742026-03-03T18:57:06.827ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45752026-03-03T18:57:06.827ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45762026-03-03T18:57:06.828ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45772026-03-03T18:57:06.833ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
45782026-03-03T18:57:06.833ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
45792026-03-03T18:57:06.833ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45802026-03-03T18:57:06.833ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45812026-03-03T18:57:06.835ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45822026-03-03T18:57:06.837ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Signaled
45832026-03-03T18:57:06.837ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
45842026-03-03T18:57:06.837ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
45852026-03-03T18:57:06.837ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
45862026-03-03T18:57:06.837ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45872026-03-03T18:57:06.838ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
45882026-03-03T18:57:06.839ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45892026-03-03T18:57:06.844ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
45902026-03-03T18:57:06.844ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45912026-03-03T18:57:06.844ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45922026-03-03T18:57:06.844ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45932026-03-03T18:57:06.845ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45942026-03-03T18:57:06.848ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
45952026-03-03T18:57:06.848ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
45962026-03-03T18:57:06.848ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45972026-03-03T18:57:06.849ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
45982026-03-03T18:57:06.851ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(7b82cae1-bfef-49b5-809c-5be3d97f2f81, 2), (7b3e1531-9e16-46a8-b395-70c01b6466c5, 2)]
45992026-03-03T18:57:06.851ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
46002026-03-03T18:57:06.851ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
46012026-03-03T18:57:06.851ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
46022026-03-03T18:57:06.851ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
46032026-03-03T18:57:06.852ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 6f 7a 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 oz..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:62989 req_id = b81e8677-f478-41cf-94c4-74ce5eec267b
46042026-03-03T18:57:06.852ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 28538,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:62989 req_id = b81e8677-f478-41cf-94c4-74ce5eec267b
46052026-03-03T18:57:06.852ZDEBGtest_metrics (store): query key key = _mgs._tcp
46062026-03-03T18:57:06.852ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
46072026-03-03T18:57:06.852ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:62989 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42517, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = b81e8677-f478-41cf-94c4-74ce5eec267b
46082026-03-03T18:57:06.853ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42517, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1964, tv_nsec: 117807240 } })
46092026-03-03T18:57:06.853ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
46102026-03-03T18:57:06.853ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 99 44 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .D..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:25600 req_id = 911bcf46-d6de-4030-815c-e201d7a2ecdd
46112026-03-03T18:57:06.853ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 39236,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:25600 req_id = 911bcf46-d6de-4030-815c-e201d7a2ecdd
46122026-03-03T18:57:06.853ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
46132026-03-03T18:57:06.853ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:25600 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 911bcf46-d6de-4030-815c-e201d7a2ecdd
46142026-03-03T18:57:06.862ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
46152026-03-03T18:57:06.863ZTRACtest_metrics (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: de 2a 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c .*..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:3035 req_id = 4662fb82-aec8-4ad6-8749-023d3025b5ba
46162026-03-03T18:57:06.863ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 56874,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:3035 req_id = 4662fb82-aec8-4ad6-8749-023d3025b5ba
46172026-03-03T18:57:06.863ZDEBGtest_metrics (store): query key key = _clickhouse-admin-keeper._tcp
46182026-03-03T18:57:06.863ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56874, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal kind = dns peer_addr = [::1]:3035 req_id = 4662fb82-aec8-4ad6-8749-023d3025b5ba
46192026-03-03T18:57:06.863ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal
46202026-03-03T18:57:06.863ZTRACtest_metrics (dns): buffer buffer = Length: 73 (0x49) bytes\n0000: 42 13 01 00 00 01 00 00 00 00 00 01 0a 5f 63 6f B............_co\n0010: 63 6b 72 6f 61 63 68 04 5f 74 63 70 0d 63 6f 6e ckroach._tcp.con\n0020: 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 trol-plane.oxide\n0030: 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 .internal..!....\n0040: 29 04 d0 00 00 00 00 00 00 )........ kind = dns peer_addr = [::1]:59553 req_id = 298f07bc-53e3-4e4b-8af3-62c9ad0de2c5
46212026-03-03T18:57:06.863ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 16915,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_cockroach._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_cockroach._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:59553 req_id = 298f07bc-53e3-4e4b-8af3-62c9ad0de2c5
46222026-03-03T18:57:06.863ZDEBGtest_metrics (store): query key key = _cockroach._tcp
46232026-03-03T18:57:06.863ZDEBGtest_metrics (store): query key key = 8b178ee8-bb89-4436-88d8-e2f462915df4.host
46242026-03-03T18:57:06.863ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:59553 query = LowerQuery { name: LowerName(Name("_cockroach._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43291, target: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal") }) }] req_id = 298f07bc-53e3-4e4b-8af3-62c9ad0de2c5
46252026-03-03T18:57:06.863ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43291, target: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1964, tv_nsec: 128447937 } })
46262026-03-03T18:57:06.863ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
46272026-03-03T18:57:06.864ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 5d 83 01 00 00 01 00 00 00 00 00 01 24 38 62 31 ]...........$8b1\n0010: 37 38 65 65 38 2d 62 62 38 39 2d 34 34 33 36 2d 78ee8-bb89-4436-\n0020: 38 38 64 38 2d 65 32 66 34 36 32 39 31 35 64 66 88d8-e2f462915df\n0030: 34 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 4.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:41592 req_id = 05704fde-8198-4451-b4f3-ec668554af58
46282026-03-03T18:57:06.864ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 23939,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 56,\n 98,\n 49,\n 55,\n 56,\n 101,\n 101,\n 56,\n 45,\n 98,\n 98,\n 56,\n 57,\n 45,\n 52,\n 52,\n 51,\n 54,\n 45,\n 56,\n 56,\n 100,\n 56,\n 45,\n 101,\n 50,\n 102,\n 52,\n 54,\n 50,\n 57,\n 49,\n 53,\n 100,\n 102,\n 52,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:41592 req_id = 05704fde-8198-4451-b4f3-ec668554af58
46292026-03-03T18:57:06.864ZDEBGtest_metrics (store): query key key = 8b178ee8-bb89-4436-88d8-e2f462915df4.host
46302026-03-03T18:57:06.864ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:41592 query = LowerQuery { name: LowerName(Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal.")), original: Query { name: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 05704fde-8198-4451-b4f3-ec668554af58
46312026-03-03T18:57:06.865ZDEBGtest_metrics (BackgroundTasks): begin collection background_task = inventory_collection
46322026-03-03T18:57:06.865ZDEBGtest_metrics (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:42517
46332026-03-03T18:57:06.865ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/ignition
46342026-03-03T18:57:06.868ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6b752af-9565-4176-bade-91ed3be10972", "content-length": "835", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46352026-03-03T18:57:06.869ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0
46362026-03-03T18:57:06.876ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b85ac038-00e1-488e-b21d-dc03b109234a", "content-length": "734", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46372026-03-03T18:57:06.876ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=0
46382026-03-03T18:57:06.881ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "62f57b06-2d3e-4893-a2ce-a831fd2eeddb", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46392026-03-03T18:57:06.881ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=1
46402026-03-03T18:57:06.882ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "682c1c1e-55d9-44e9-9fae-f27a66d125e0", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46412026-03-03T18:57:06.882ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=0
46422026-03-03T18:57:06.883ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7321769d-4623-40c6-b151-098506e70696", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46432026-03-03T18:57:06.883ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=1
46442026-03-03T18:57:06.884ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7d29443-cedd-49ab-b66d-9d7f4bfbf471", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46452026-03-03T18:57:06.884ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=0
46462026-03-03T18:57:06.885ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1caf0a40-f674-4761-ae09-aa862cb40ab3", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46472026-03-03T18:57:06.885ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=1
46482026-03-03T18:57:06.886ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "07108bcf-22bb-4a28-a412-8adaa535739d", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46492026-03-03T18:57:06.886ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cmpa
46502026-03-03T18:57:06.887ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ca600a2-10db-4fe5-a757-b98995efc92a", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46512026-03-03T18:57:06.887ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
46522026-03-03T18:57:06.889ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "200fd2e5-599c-4c72-8292-bf102bc457e1", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46532026-03-03T18:57:06.889ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
46542026-03-03T18:57:06.889ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e58e804-493e-4bd6-ad36-57024ee758c7", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46552026-03-03T18:57:06.889ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
46562026-03-03T18:57:06.890ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
46572026-03-03T18:57:06.892ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "979e2641-4587-4105-80ce-ab69d34ecbe2", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46582026-03-03T18:57:06.892ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1
46592026-03-03T18:57:06.892ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6da2130d-8072-42e6-98de-9db45150528a", "content-length": "734", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46602026-03-03T18:57:06.892ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=0
46612026-03-03T18:57:06.892ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e731e69-2350-47e6-a083-eae8e43784c7", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46622026-03-03T18:57:06.892ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=1
46632026-03-03T18:57:06.894ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "394a505c-044f-470c-b639-e073567c86a7", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46642026-03-03T18:57:06.894ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=0
46652026-03-03T18:57:06.894ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "adbbaace-e41e-4af0-97bb-e0ea490b09ed", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46662026-03-03T18:57:06.894ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=1
46672026-03-03T18:57:06.894ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "05538669-d379-4531-820d-1f6dd7204d04", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46682026-03-03T18:57:06.894ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=0
46692026-03-03T18:57:06.895ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "976db0af-1509-455c-8114-4d3924d0dd8e", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46702026-03-03T18:57:06.895ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=1
46712026-03-03T18:57:06.896ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "30b92ef5-4f69-4937-9dd4-1f233b20d587", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46722026-03-03T18:57:06.897ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cmpa
46732026-03-03T18:57:06.897ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "37ccab01-1ee8-48f7-bfc9-7236a08eff24", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46742026-03-03T18:57:06.897ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
46752026-03-03T18:57:06.897ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbc49146-9ac3-4c96-86ae-9013b002dabe", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46762026-03-03T18:57:06.897ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
46772026-03-03T18:57:06.897ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "82221ce8-4d86-4835-99b5-16e4d89d94c0", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46782026-03-03T18:57:06.897ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
46792026-03-03T18:57:06.898ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "da35f2c0-95de-4aab-a356-6cbbb8aae242", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46802026-03-03T18:57:06.898ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0
46812026-03-03T18:57:06.899ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "efe1f245-ec49-48f8-b314-fca9e0d0b60c", "content-length": "723", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46822026-03-03T18:57:06.899ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/active-slot
46832026-03-03T18:57:06.899ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7717452-464b-416e-885e-d4853c31f247", "content-length": "10", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46842026-03-03T18:57:06.899ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/0
46852026-03-03T18:57:06.900ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "aebae1d5-0b29-4b29-a8e5-b59ca9e25c31", "content-length": "144", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46862026-03-03T18:57:06.900ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/1
46872026-03-03T18:57:06.900ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf78b530-67de-4de6-b7c0-bd406f78c902", "content-length": "147", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46882026-03-03T18:57:06.900ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=0
46892026-03-03T18:57:06.901ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "50dce8d4-11c4-4880-ad45-387ab83aed0b", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46902026-03-03T18:57:06.901ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=1
46912026-03-03T18:57:06.902ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "21d91ba9-214e-4c75-90a2-7aa9c2eab958", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46922026-03-03T18:57:06.902ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=0
46932026-03-03T18:57:06.902ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ade7e3ed-51b4-451b-9744-be6b3023f4b0", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46942026-03-03T18:57:06.902ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=1
46952026-03-03T18:57:06.903ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "74d349f5-438c-4e98-99e8-9d1f3522315c", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46962026-03-03T18:57:06.903ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=0
46972026-03-03T18:57:06.904ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0a462c8-e5fc-405a-99d7-f2e4c4bb39e0", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
46982026-03-03T18:57:06.904ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=1
46992026-03-03T18:57:06.904ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd73a475-c2d6-4a09-8979-fc4867842e46", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47002026-03-03T18:57:06.905ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cmpa
47012026-03-03T18:57:06.905ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a4f7f98-edd8-4421-9326-eca3415385a4", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47022026-03-03T18:57:06.905ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
47032026-03-03T18:57:06.906ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5839958e-0592-4912-8709-328d31146355", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47042026-03-03T18:57:06.906ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
47052026-03-03T18:57:06.906ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f9985c6-812b-4e31-b626-18e629082aff", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47062026-03-03T18:57:06.906ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
47072026-03-03T18:57:06.907ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "910a1587-534d-4cba-84ae-c5f647f2c6ef", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47082026-03-03T18:57:06.907ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1
47092026-03-03T18:57:06.907ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "01c0e6c7-185d-463f-be1f-232cc4316470", "content-length": "723", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47102026-03-03T18:57:06.907ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/active-slot
47112026-03-03T18:57:06.908ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "64f3377a-2488-4014-991a-5be6d0a44947", "content-length": "10", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47122026-03-03T18:57:06.908ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/0
47132026-03-03T18:57:06.908ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7bd599d-4fe2-438c-b41f-aa760b6faae8", "content-length": "144", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47142026-03-03T18:57:06.909ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/1
47152026-03-03T18:57:06.916ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "065eec5f-81f7-42bc-8dd0-07037da31756", "content-length": "147", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47162026-03-03T18:57:06.916ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=0
47172026-03-03T18:57:06.917ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd55515f-6553-4c76-843f-8d56a2d18458", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47182026-03-03T18:57:06.918ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=1
47192026-03-03T18:57:06.919ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "851cb341-2e6e-4feb-85ff-2455cfd1601c", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47202026-03-03T18:57:06.919ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=0
47212026-03-03T18:57:06.919ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cee82353-5820-4a5b-b47a-e19a71aeee54", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47222026-03-03T18:57:06.919ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=1
47232026-03-03T18:57:06.920ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "377043f9-fd5b-4d34-8d46-66fcf2239470", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47242026-03-03T18:57:06.920ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=0
47252026-03-03T18:57:06.920ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "75378310-1c0c-477d-9a33-2648b51bf439", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47262026-03-03T18:57:06.920ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=1
47272026-03-03T18:57:06.921ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cb2e353-b52a-4fca-87bd-19567917be98", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47282026-03-03T18:57:06.921ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cmpa
47292026-03-03T18:57:06.922ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f0d2492-449e-4cd8-ac32-45a0e18cb11e", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47302026-03-03T18:57:06.922ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
47312026-03-03T18:57:06.922ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f58632a6-2200-400a-a3f8-aab76b9609ef", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47322026-03-03T18:57:06.922ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
47332026-03-03T18:57:06.923ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5e6f985-2cd7-4029-ac7f-6a77f7d71bad", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47342026-03-03T18:57:06.923ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
47352026-03-03T18:57:06.924ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6a036c2-6f2a-4027-bf66-00b1c8cfccfe", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:06 GMT"} })
47362026-03-03T18:57:06.924ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
47372026-03-03T18:57:06.924ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
47382026-03-03T18:57:06.924ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
47392026-03-03T18:57:06.924ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47402026-03-03T18:57:06.924ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
47412026-03-03T18:57:06.937ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47422026-03-03T18:57:06.940ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
47432026-03-03T18:57:06.940ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
47442026-03-03T18:57:06.940ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
47452026-03-03T18:57:06.941ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
47462026-03-03T18:57:06.941ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47472026-03-03T18:57:06.941ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
47482026-03-03T18:57:06.942ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
47492026-03-03T18:57:06.942ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
47502026-03-03T18:57:06.942ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
47512026-03-03T18:57:06.942ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
47522026-03-03T18:57:06.942ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
47532026-03-03T18:57:06.943ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47542026-03-03T18:57:06.946ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
47552026-03-03T18:57:06.946ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
47562026-03-03T18:57:06.946ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47572026-03-03T18:57:06.947ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
47582026-03-03T18:57:06.947ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47592026-03-03T18:57:06.951ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
47602026-03-03T18:57:06.951ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
47612026-03-03T18:57:06.951ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
47622026-03-03T18:57:06.952ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
47632026-03-03T18:57:06.981ZDEBGtest_metrics (producer-registration-task): will register with Nexus at 127.0.0.1:41339
47642026-03-03T18:57:06.991ZDEBGtest_metrics (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:41339/metrics/producers
47652026-03-03T18:57:06.994ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
47662026-03-03T18:57:06.994ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
47672026-03-03T18:57:06.994ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
47682026-03-03T18:57:06.994ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:41339 remote_addr = 127.0.0.1:36740
47692026-03-03T18:57:06.994ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36740 req_id = 011a2e6d-d873-4043-ba5c-e2f66a47a9d4 uri = /metrics/producers
47702026-03-03T18:57:06.994ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36740 req_id = 011a2e6d-d873-4043-ba5c-e2f66a47a9d4 uri = /metrics/producers version = 1.0.0
47712026-03-03T18:57:06.994ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36740 req_id = 011a2e6d-d873-4043-ba5c-e2f66a47a9d4 resource = Database type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
47722026-03-03T18:57:06.994ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36740 req_id = 011a2e6d-d873-4043-ba5c-e2f66a47a9d4 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
47732026-03-03T18:57:06.994ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36740 req_id = 011a2e6d-d873-4043-ba5c-e2f66a47a9d4 resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
47742026-03-03T18:57:07.015ZDEBGtest_metrics (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 2 reason = Timeout
47752026-03-03T18:57:07.015ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig
47762026-03-03T18:57:07.015ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = reconfigurator_config_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
47772026-03-03T18:57:07.015ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
47782026-03-03T18:57:07.016ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
47792026-03-03T18:57:07.016ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
47802026-03-03T18:57:07.018ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47812026-03-03T18:57:07.022ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
47822026-03-03T18:57:07.022ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
47832026-03-03T18:57:07.023ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
47842026-03-03T18:57:07.023ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
47852026-03-03T18:57:07.024ZDEBGtest_metrics (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: false, planner_config: PlannerConfig { add_zones_with_mupdate_override: false }, tuf_repo_pruner_enabled: true }, time_modified: 2026-03-03T18:57:01.943241Z })
47862026-03-03T18:57:07.024ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 8.837944ms iteration = 2 status = {"config_updated":false}
47872026-03-03T18:57:07.033ZINFOtest_metrics (nexus): assigned collector to new producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 producer_id = 913233fe-92a8-4635-9572-183f495429c4
47882026-03-03T18:57:07.033ZINFOtest_metrics (dropshot_internal): request completed latency_us = 40406 local_addr = 127.0.0.1:41339 method = POST remote_addr = 127.0.0.1:36740 req_id = 011a2e6d-d873-4043-ba5c-e2f66a47a9d4 response_code = 201 uri = /metrics/producers
47892026-03-03T18:57:07.034ZDEBGtest_metrics (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "011a2e6d-d873-4043-ba5c-e2f66a47a9d4", "content-length": "41", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
47902026-03-03T18:57:07.034ZDEBGtest_metrics (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
47912026-03-03T18:57:07.045ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
47922026-03-03T18:57:07.055ZDEBGtest_metrics (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:36085
47932026-03-03T18:57:07.055ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = http://[::1]:36085 background_task = inventory_collection body = None method = GET uri = http://[::1]:36085/inventory
47942026-03-03T18:57:07.056ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35812 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
47952026-03-03T18:57:07.056ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
47962026-03-03T18:57:07.056ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
47972026-03-03T18:57:07.057ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = GET remote_addr = [::1]:35812 req_id = bf5653e7-4cd7-4260-93d7-5e95b00dabf6 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
47982026-03-03T18:57:07.057ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = GET remote_addr = [::1]:35812 req_id = bf5653e7-4cd7-4260-93d7-5e95b00dabf6 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory version = 23.0.0
47992026-03-03T18:57:07.058ZINFOtest_metrics (dropshot): request completed latency_us = 1485 local_addr = [::1]:36085 method = GET remote_addr = [::1]:35812 req_id = bf5653e7-4cd7-4260-93d7-5e95b00dabf6 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
48002026-03-03T18:57:07.059ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = http://[::1]:36085 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:36085/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf5653e7-4cd7-4260-93d7-5e95b00dabf6", "content-length": "20979", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
48012026-03-03T18:57:07.065ZDEBGtest_metrics (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
48022026-03-03T18:57:07.065ZDEBGtest_metrics (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
48032026-03-03T18:57:07.065ZDEBGtest_metrics (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
48042026-03-03T18:57:07.065ZDEBGtest_metrics (CockroachClusterAdminClient): client request body = None method = GET uri = http://[::1]:32222/node/id
48052026-03-03T18:57:07.066ZDEBGtest_metrics (CockroachClusterAdminClient): client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
48062026-03-03T18:57:07.067ZWARNtest_metrics (CockroachClusterAdminClient): Failed to fetch metrics from CockroachDB node error = Failed to get node ID from [::1]:32222
48072026-03-03T18:57:07.077ZDEBGtest_metrics (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[::1]:10123 zone_id = 128cd5ee-2d78-44f6-9fb4-83dda8b3d1a4 (omicron_zone)
48082026-03-03T18:57:07.077ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[::1]:10123 uri = http://[::1]:10123/timesync
48092026-03-03T18:57:07.078ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[::1]:10123 result = Err(reqwest::Error { kind: Request, url: "http://[::1]:10123/timesync", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:10123, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
48102026-03-03T18:57:07.078ZDEBGtest_metrics (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
48112026-03-03T18:57:07.096ZDEBGtest_metrics (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 2a83ee47-a98f-4924-a414-6bdba496b84f (omicron_zone)
48122026-03-03T18:57:07.096ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[::1]:34487 method = GET uri = http://[::1]:34487/config
48132026-03-03T18:57:07.096ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:34487 remote_addr = [::1]:39244
48142026-03-03T18:57:07.100ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:34487 method = GET remote_addr = [::1]:39244 req_id = 9d862eb2-4067-43d4-b9df-8c7ff55c5a96 uri = /config
48152026-03-03T18:57:07.100ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:34487 method = GET remote_addr = [::1]:39244 req_id = 9d862eb2-4067-43d4-b9df-8c7ff55c5a96 uri = /config version = 2.0.0
48162026-03-03T18:57:07.100ZINFOtest_metrics (http): request completed kind = dns latency_us = 803 local_addr = [::1]:34487 method = GET remote_addr = [::1]:39244 req_id = 9d862eb2-4067-43d4-b9df-8c7ff55c5a96 response_code = 200 uri = /config
48172026-03-03T18:57:07.100ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
48182026-03-03T18:57:07.101ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48192026-03-03T18:57:07.101ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48202026-03-03T18:57:07.101ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48212026-03-03T18:57:07.101ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48222026-03-03T18:57:07.102ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[::1]:34487 result = Ok(Response { url: "http://[::1]:34487/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d862eb2-4067-43d4-b9df-8c7ff55c5a96", "content-length": "3478", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
48232026-03-03T18:57:07.102ZDEBGtest_metrics (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 2a83ee47-a98f-4924-a414-6bdba496b84f (omicron_zone)
48242026-03-03T18:57:07.102ZDEBGtest_metrics (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
48252026-03-03T18:57:07.102ZDEBGtest_metrics (BackgroundTasks): finished collection background_task = inventory_collection
48262026-03-03T18:57:07.102ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
48272026-03-03T18:57:07.102ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48282026-03-03T18:57:07.102ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
48292026-03-03T18:57:07.102ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
48302026-03-03T18:57:07.103ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
48312026-03-03T18:57:07.107ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48322026-03-03T18:57:07.111ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
48332026-03-03T18:57:07.111ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48342026-03-03T18:57:07.111ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48352026-03-03T18:57:07.111ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48362026-03-03T18:57:07.112ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48372026-03-03T18:57:07.115ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
48382026-03-03T18:57:07.115ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
48392026-03-03T18:57:07.115ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
48402026-03-03T18:57:07.116ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
48412026-03-03T18:57:07.124ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48422026-03-03T18:57:07.124ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48432026-03-03T18:57:07.124ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48442026-03-03T18:57:07.202ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
48452026-03-03T18:57:07.253ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
48462026-03-03T18:57:07.254ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48472026-03-03T18:57:07.254ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48482026-03-03T18:57:07.254ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48492026-03-03T18:57:07.255ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48502026-03-03T18:57:07.256ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48512026-03-03T18:57:07.260ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
48522026-03-03T18:57:07.260ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48532026-03-03T18:57:07.260ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48542026-03-03T18:57:07.261ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48552026-03-03T18:57:07.338ZINFOtest_metrics (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 20823b1e-db9e-40d4-a18e-a9543ccf5292
48562026-03-03T18:57:07.338ZDEBGtest_metrics (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 20823b1e-db9e-40d4-a18e-a9543ccf5292 time_started = 2026-03-03 18:57:06.865205 UTC
48572026-03-03T18:57:07.338ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 500.882448ms iteration = 4 status = {"collection_id":"20823b1e-db9e-40d4-a18e-a9543ccf5292","time_done":"2026-03-03 18:57:07.102427 UTC","time_started":"2026-03-03 18:57:06.865205 UTC"}
48582026-03-03T18:57:07.338ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 5 reason = Signaled
48592026-03-03T18:57:07.338ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
48602026-03-03T18:57:07.338ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48612026-03-03T18:57:07.338ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
48622026-03-03T18:57:07.338ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
48632026-03-03T18:57:07.339ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
48642026-03-03T18:57:07.339ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 4 reason = Dependency
48652026-03-03T18:57:07.339ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
48662026-03-03T18:57:07.339ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48672026-03-03T18:57:07.339ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
48682026-03-03T18:57:07.339ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
48692026-03-03T18:57:07.340ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
48702026-03-03T18:57:07.343ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48712026-03-03T18:57:07.346ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
48722026-03-03T18:57:07.346ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
48732026-03-03T18:57:07.346ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
48742026-03-03T18:57:07.347ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
48752026-03-03T18:57:07.347ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48762026-03-03T18:57:07.354ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
48772026-03-03T18:57:07.354ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
48782026-03-03T18:57:07.354ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
48792026-03-03T18:57:07.355ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
48802026-03-03T18:57:07.356ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48812026-03-03T18:57:07.356ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48822026-03-03T18:57:07.356ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48832026-03-03T18:57:07.358ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
48842026-03-03T18:57:07.358ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
48852026-03-03T18:57:07.359ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
48862026-03-03T18:57:07.359ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(7b82cae1-bfef-49b5-809c-5be3d97f2f81, 2), (7b3e1531-9e16-46a8-b395-70c01b6466c5, 2), (20823b1e-db9e-40d4-a18e-a9543ccf5292, 2)]
48872026-03-03T18:57:07.359ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
48882026-03-03T18:57:07.360ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: f3 56 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .V..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:45106 req_id = 05307f7e-93a3-4f3b-984b-7a11220237cb
48892026-03-03T18:57:07.360ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 62294,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:45106 req_id = 05307f7e-93a3-4f3b-984b-7a11220237cb
48902026-03-03T18:57:07.360ZDEBGtest_metrics (store): query key key = _mgs._tcp
48912026-03-03T18:57:07.360ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
48922026-03-03T18:57:07.360ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:45106 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42517, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 05307f7e-93a3-4f3b-984b-7a11220237cb
48932026-03-03T18:57:07.360ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42517, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1964, tv_nsec: 625388220 } })
48942026-03-03T18:57:07.360ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
48952026-03-03T18:57:07.361ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: f0 ad 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:52798 req_id = 01457054-d576-4145-a227-94f59d1173d4
48962026-03-03T18:57:07.361ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 61613,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:52798 req_id = 01457054-d576-4145-a227-94f59d1173d4
48972026-03-03T18:57:07.362ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
48982026-03-03T18:57:07.362ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:52798 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 01457054-d576-4145-a227-94f59d1173d4
48992026-03-03T18:57:07.369ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
49002026-03-03T18:57:07.370ZTRACtest_metrics (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 04 1e 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:33129 req_id = 88e23e55-5368-4be3-912a-d31f50cce643
49012026-03-03T18:57:07.371ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 1054,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:33129 req_id = 88e23e55-5368-4be3-912a-d31f50cce643
49022026-03-03T18:57:07.371ZDEBGtest_metrics (store): query key key = _clickhouse-admin-keeper._tcp
49032026-03-03T18:57:07.371ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1054, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal kind = dns peer_addr = [::1]:33129 req_id = 88e23e55-5368-4be3-912a-d31f50cce643
49042026-03-03T18:57:07.371ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal
49052026-03-03T18:57:07.371ZTRACtest_metrics (dns): buffer buffer = Length: 73 (0x49) bytes\n0000: e2 7f 01 00 00 01 00 00 00 00 00 01 0a 5f 63 6f ............._co\n0010: 63 6b 72 6f 61 63 68 04 5f 74 63 70 0d 63 6f 6e ckroach._tcp.con\n0020: 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 trol-plane.oxide\n0030: 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 .internal..!....\n0040: 29 04 d0 00 00 00 00 00 00 )........ kind = dns peer_addr = [::1]:27830 req_id = 04321046-ccbc-4f1c-b53b-e646f4ba4999
49062026-03-03T18:57:07.371ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 57983,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_cockroach._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_cockroach._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:27830 req_id = 04321046-ccbc-4f1c-b53b-e646f4ba4999
49072026-03-03T18:57:07.371ZDEBGtest_metrics (store): query key key = _cockroach._tcp
49082026-03-03T18:57:07.371ZDEBGtest_metrics (store): query key key = 8b178ee8-bb89-4436-88d8-e2f462915df4.host
49092026-03-03T18:57:07.371ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:27830 query = LowerQuery { name: LowerName(Name("_cockroach._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43291, target: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal") }) }] req_id = 04321046-ccbc-4f1c-b53b-e646f4ba4999
49102026-03-03T18:57:07.371ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43291, target: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1964, tv_nsec: 635528595 } })
49112026-03-03T18:57:07.371ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
49122026-03-03T18:57:07.371ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 60 ae 01 00 00 01 00 00 00 00 00 01 24 38 62 31 `...........$8b1\n0010: 37 38 65 65 38 2d 62 62 38 39 2d 34 34 33 36 2d 78ee8-bb89-4436-\n0020: 38 38 64 38 2d 65 32 66 34 36 32 39 31 35 64 66 88d8-e2f462915df\n0030: 34 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 4.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:63548 req_id = fe341cd5-a79e-4164-ade3-1bc7fbe0e40d
49132026-03-03T18:57:07.371ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 24750,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 56,\n 98,\n 49,\n 55,\n 56,\n 101,\n 101,\n 56,\n 45,\n 98,\n 98,\n 56,\n 57,\n 45,\n 52,\n 52,\n 51,\n 54,\n 45,\n 56,\n 56,\n 100,\n 56,\n 45,\n 101,\n 50,\n 102,\n 52,\n 54,\n 50,\n 57,\n 49,\n 53,\n 100,\n 102,\n 52,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:63548 req_id = fe341cd5-a79e-4164-ade3-1bc7fbe0e40d
49142026-03-03T18:57:07.371ZDEBGtest_metrics (store): query key key = 8b178ee8-bb89-4436-88d8-e2f462915df4.host
49152026-03-03T18:57:07.371ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:63548 query = LowerQuery { name: LowerName(Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal.")), original: Query { name: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = fe341cd5-a79e-4164-ade3-1bc7fbe0e40d
49162026-03-03T18:57:07.371ZDEBGtest_metrics (BackgroundTasks): begin collection background_task = inventory_collection
49172026-03-03T18:57:07.371ZDEBGtest_metrics (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:42517
49182026-03-03T18:57:07.371ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/ignition
49192026-03-03T18:57:07.373ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "9be3d3ff-1d2e-458d-b0dc-69d81aa0a7ec", "content-length": "835", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49202026-03-03T18:57:07.373ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0
49212026-03-03T18:57:07.374ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7054f55-dcbf-450a-8192-185e5f2da617", "content-length": "734", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49222026-03-03T18:57:07.374ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=0
49232026-03-03T18:57:07.375ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a01566b8-ded3-4c2e-957c-1def0f4f8548", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49242026-03-03T18:57:07.375ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=1
49252026-03-03T18:57:07.376ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4abc73a2-ba3a-4003-b169-c16b54a7e894", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49262026-03-03T18:57:07.376ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=0
49272026-03-03T18:57:07.377ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f26bf00e-6fee-4f39-a53b-81ae7ba250ce", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49282026-03-03T18:57:07.377ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=1
49292026-03-03T18:57:07.378ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c603087-e3c2-40d4-b736-74bd2dcd175b", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49302026-03-03T18:57:07.378ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=0
49312026-03-03T18:57:07.379ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4df6a79f-bbb6-4fcc-b255-63f9fdf3eb07", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49322026-03-03T18:57:07.379ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=1
49332026-03-03T18:57:07.380ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "14273205-7236-4060-b9e3-7e65a712cd60", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49342026-03-03T18:57:07.380ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cmpa
49352026-03-03T18:57:07.381ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dd37144-0c84-4dc3-a9ff-f9a8f72bf0ac", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49362026-03-03T18:57:07.381ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
49372026-03-03T18:57:07.381ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c547c8fb-8779-4222-ac23-76355c51d7e6", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49382026-03-03T18:57:07.381ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
49392026-03-03T18:57:07.382ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "29277315-fc86-40db-8e87-73b21e31bf1f", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49402026-03-03T18:57:07.383ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
49412026-03-03T18:57:07.383ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "10826856-7ee4-49f7-b91c-88bf5dd5daf7", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49422026-03-03T18:57:07.384ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1
49432026-03-03T18:57:07.384ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb2fc34d-bf36-42a3-aaed-0368b9a4a868", "content-length": "734", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49442026-03-03T18:57:07.384ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=0
49452026-03-03T18:57:07.385ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "11ad6ddf-0e97-4f7b-afc8-0ccac85edfcc", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49462026-03-03T18:57:07.386ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=1
49472026-03-03T18:57:07.386ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d7a2006-e0fd-426b-8515-4dd4f4d8f08f", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49482026-03-03T18:57:07.386ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=0
49492026-03-03T18:57:07.388ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "378192f3-97b0-4078-8609-9f52ac2ca567", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49502026-03-03T18:57:07.388ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=1
49512026-03-03T18:57:07.389ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6177b5c7-848b-43fd-b91b-cc8fea6ef3de", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49522026-03-03T18:57:07.389ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=0
49532026-03-03T18:57:07.389ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecf16b31-995e-4ca5-9e5f-5c15958068a9", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49542026-03-03T18:57:07.389ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=1
49552026-03-03T18:57:07.390ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "95e8d409-3524-42e9-8bde-85379791c8ea", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49562026-03-03T18:57:07.390ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cmpa
49572026-03-03T18:57:07.391ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cbb418e-3788-4ecd-b0dd-7463e57588f2", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49582026-03-03T18:57:07.391ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
49592026-03-03T18:57:07.392ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 52.4912ms iteration = 4 status = {"Loaded":{"collection_id":"20823b1e-db9e-40d4-a18e-a9543ccf5292","time_loaded":"2026-03-03T18:57:07.339818260Z","time_started":"2026-03-03T18:57:06.865205Z"}}
49602026-03-03T18:57:07.392ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Dependency
49612026-03-03T18:57:07.392ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
49622026-03-03T18:57:07.392ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
49632026-03-03T18:57:07.392ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
49642026-03-03T18:57:07.392ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
49652026-03-03T18:57:07.393ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
49662026-03-03T18:57:07.393ZDEBGtest_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Dependency
49672026-03-03T18:57:07.393ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 16.56\u{b5}s iteration = 4 status = {"error":"task disabled"}
49682026-03-03T18:57:07.393ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 4 reason = Dependency
49692026-03-03T18:57:07.393ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
49702026-03-03T18:57:07.393ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
49712026-03-03T18:57:07.393ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
49722026-03-03T18:57:07.393ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 6 reason = Dependency
49732026-03-03T18:57:07.393ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
49742026-03-03T18:57:07.393ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 15.57\u{b5}s iteration = 6 status = "Disabled"
49752026-03-03T18:57:07.394ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 88 ae 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:46098 req_id = 85b95b45-11a9-41f8-bf55-f092ef62b07f
49762026-03-03T18:57:07.394ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 34990,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:46098 req_id = 85b95b45-11a9-41f8-bf55-f092ef62b07f
49772026-03-03T18:57:07.394ZDEBGtest_metrics (store): query key key = _dendrite._tcp
49782026-03-03T18:57:07.394ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
49792026-03-03T18:57:07.394ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:46098 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 85b95b45-11a9-41f8-bf55-f092ef62b07f
49802026-03-03T18:57:07.395ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1964, tv_nsec: 659688872 } })
49812026-03-03T18:57:07.395ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
49822026-03-03T18:57:07.395ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a76260f5-e2f4-4bd9-b756-dbe2dae4140e", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
49832026-03-03T18:57:07.395ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
49842026-03-03T18:57:07.395ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49852026-03-03T18:57:07.398ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
49862026-03-03T18:57:07.398ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
49872026-03-03T18:57:07.398ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
49882026-03-03T18:57:07.398ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
49892026-03-03T18:57:07.398ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
49902026-03-03T18:57:07.398ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
49912026-03-03T18:57:07.400ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 8f 64 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .d..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:33872 req_id = 16383e1d-d4a2-4af0-8f6b-1cba03936e52
49922026-03-03T18:57:07.400ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 36708,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:33872 req_id = 16383e1d-d4a2-4af0-8f6b-1cba03936e52
49932026-03-03T18:57:07.400ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
49942026-03-03T18:57:07.400ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:33872 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 16383e1d-d4a2-4af0-8f6b-1cba03936e52
49952026-03-03T18:57:07.418ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:34679/switch/identifiers
49962026-03-03T18:57:07.419ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49972026-03-03T18:57:07.422ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
49982026-03-03T18:57:07.422ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
49992026-03-03T18:57:07.422ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50002026-03-03T18:57:07.422ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50012026-03-03T18:57:07.423ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
50022026-03-03T18:57:07.424ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:43333 method = GET path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
50032026-03-03T18:57:07.424ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:43333 method = POST path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
50042026-03-03T18:57:07.424ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:43333 method = DELETE path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
50052026-03-03T18:57:07.424ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:43333 method = GET path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
50062026-03-03T18:57:07.424ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:43333 method = GET path = /crucible/0/regions/{id}/snapshots server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
50072026-03-03T18:57:07.424ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:43333 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
50082026-03-03T18:57:07.424ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:43333 method = GET path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
50092026-03-03T18:57:07.424ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:43333 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
50102026-03-03T18:57:07.424ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:43333 method = POST path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
50112026-03-03T18:57:07.424ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): listening kind = storage local_addr = [::1]:43333 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
50122026-03-03T18:57:07.424ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): successfully registered DTrace USDT probes kind = storage local_addr = [::1]:43333 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
50132026-03-03T18:57:07.424ZINFOtest_metrics (SledAgent): Created Simulated Crucible Server address = [::1]:43333 kind = storage server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
50142026-03-03T18:57:07.424ZINFOtest_metrics (nexus): inserting test physical disk model = test-model physical_disk_id = 533fa386-1c38-4fa8-b93e-c679c92c7584 serial = totally-unique-serial: 533fa386-1c38-4fa8-b93e-c679c92c7584 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
50152026-03-03T18:57:07.424ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
50162026-03-03T18:57:07.424ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
50172026-03-03T18:57:07.425ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
50182026-03-03T18:57:07.425ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "73c6b169-0d94-4636-ab79-a4e14ecabb07", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
50192026-03-03T18:57:07.425ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
50202026-03-03T18:57:07.426ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:34679/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ee3c380-2361-485e-8ed9-dcd17724a803", "content-length": "206", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
50212026-03-03T18:57:07.426ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
50222026-03-03T18:57:07.428ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
50232026-03-03T18:57:07.428ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
50242026-03-03T18:57:07.428ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
50252026-03-03T18:57:07.428ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
50262026-03-03T18:57:07.428ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50272026-03-03T18:57:07.428ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
50282026-03-03T18:57:07.428ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50292026-03-03T18:57:07.428ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50302026-03-03T18:57:07.428ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
50312026-03-03T18:57:07.428ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
50322026-03-03T18:57:07.429ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
50332026-03-03T18:57:07.429ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6add4af-f84a-417c-83d1-11c14a0d66ef", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
50342026-03-03T18:57:07.430ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0
50352026-03-03T18:57:07.430ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
50362026-03-03T18:57:07.430ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
50372026-03-03T18:57:07.430ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
50382026-03-03T18:57:07.430ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
50392026-03-03T18:57:07.430ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
50402026-03-03T18:57:07.430ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50412026-03-03T18:57:07.433ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
50422026-03-03T18:57:07.433ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
50432026-03-03T18:57:07.433ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50442026-03-03T18:57:07.433ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
50452026-03-03T18:57:07.433ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50462026-03-03T18:57:07.433ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50472026-03-03T18:57:07.434ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
50482026-03-03T18:57:07.434ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50492026-03-03T18:57:07.434ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
50502026-03-03T18:57:07.434ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
50512026-03-03T18:57:07.434ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
50522026-03-03T18:57:07.435ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
50532026-03-03T18:57:07.436ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
50542026-03-03T18:57:07.436ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
50552026-03-03T18:57:07.436ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
50562026-03-03T18:57:07.436ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
50572026-03-03T18:57:07.436ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50582026-03-03T18:57:07.438ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
50592026-03-03T18:57:07.438ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
50602026-03-03T18:57:07.438ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50612026-03-03T18:57:07.439ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50622026-03-03T18:57:07.440ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50632026-03-03T18:57:07.445ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
50642026-03-03T18:57:07.449ZINFOtest_metrics (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous num_already_exist = 0 num_inserted = 0 num_not_in_inventory = 0
50652026-03-03T18:57:07.449ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
50662026-03-03T18:57:07.449ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50672026-03-03T18:57:07.449ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
50682026-03-03T18:57:07.449ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50692026-03-03T18:57:07.449ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50702026-03-03T18:57:07.449ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee33bd58-3fc3-4a49-adb3-a665f089fa4f", "content-length": "723", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
50712026-03-03T18:57:07.449ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/active-slot
50722026-03-03T18:57:07.449ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea51e8fc-21ad-4a24-83d4-64667da73857", "content-length": "10", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
50732026-03-03T18:57:07.450ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/0
50742026-03-03T18:57:07.450ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e997caca-a417-40bb-b15d-9cbefc781e6d", "content-length": "144", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
50752026-03-03T18:57:07.450ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/1
50762026-03-03T18:57:07.450ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9099e0d1-01f0-4f62-ba9c-03c44f410dff", "content-length": "147", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
50772026-03-03T18:57:07.450ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=0
50782026-03-03T18:57:07.450ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "84e5ac7c-46d2-45ff-95f5-f32b879043c6", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
50792026-03-03T18:57:07.450ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=1
50802026-03-03T18:57:07.450ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cc281a9-9781-4217-b4ba-72ba3b6238c2", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
50812026-03-03T18:57:07.450ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=0
50822026-03-03T18:57:07.450ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7f62f58-2e23-4c30-9bce-58281d4e7e73", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
50832026-03-03T18:57:07.451ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=1
50842026-03-03T18:57:07.452ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50852026-03-03T18:57:07.453ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
50862026-03-03T18:57:07.453ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
50872026-03-03T18:57:07.453ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50882026-03-03T18:57:07.453ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
50892026-03-03T18:57:07.453ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50902026-03-03T18:57:07.453ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50912026-03-03T18:57:07.454ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d84ae21-8ff1-4300-a9cb-a0a715ff8d11", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
50922026-03-03T18:57:07.455ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=0
50932026-03-03T18:57:07.455ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "26b0487c-0fd7-4727-8d30-53cebfdd9a51", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
50942026-03-03T18:57:07.455ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=1
50952026-03-03T18:57:07.455ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50962026-03-03T18:57:07.459ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
50972026-03-03T18:57:07.459ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
50982026-03-03T18:57:07.460ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50992026-03-03T18:57:07.460ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51002026-03-03T18:57:07.461ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3efc59d3-bf8b-4e3e-adca-9b301001dfba", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51012026-03-03T18:57:07.461ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cmpa
51022026-03-03T18:57:07.461ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "96de1392-3c1f-40ff-af73-6a4f7cbbe829", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51032026-03-03T18:57:07.462ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
51042026-03-03T18:57:07.462ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "23f613f7-a8d5-4be0-bfbb-3ffc1d4eb97b", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51052026-03-03T18:57:07.462ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
51062026-03-03T18:57:07.463ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4818a143-0284-41ae-856a-e514b825330e", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51072026-03-03T18:57:07.463ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
51082026-03-03T18:57:07.463ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a67acfb-0448-4b86-93ae-d3536be06396", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51092026-03-03T18:57:07.463ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1
51102026-03-03T18:57:07.464ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f257e283-462e-44e0-b2f3-1c540cc1adba", "content-length": "723", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51112026-03-03T18:57:07.464ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/active-slot
51122026-03-03T18:57:07.465ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b19c88c-4825-448d-8086-caabc4c21e56", "content-length": "10", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51132026-03-03T18:57:07.465ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/0
51142026-03-03T18:57:07.465ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "03d17080-ee59-4a7d-b565-29fb45c297c8", "content-length": "144", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51152026-03-03T18:57:07.465ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/1
51162026-03-03T18:57:07.467ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "11f2e601-ca7e-4585-89f1-24eab4820de7", "content-length": "147", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51172026-03-03T18:57:07.467ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=0
51182026-03-03T18:57:07.467ZINFOtest_metrics (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
51192026-03-03T18:57:07.467ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
51202026-03-03T18:57:07.467ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51212026-03-03T18:57:07.467ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
51222026-03-03T18:57:07.467ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51232026-03-03T18:57:07.467ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51242026-03-03T18:57:07.467ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "602bc429-1faf-40ac-871e-1df39eae26a5", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51252026-03-03T18:57:07.467ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=1
51262026-03-03T18:57:07.468ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51272026-03-03T18:57:07.471ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
51282026-03-03T18:57:07.474ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
51292026-03-03T18:57:07.474ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51302026-03-03T18:57:07.474ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
51312026-03-03T18:57:07.474ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51322026-03-03T18:57:07.474ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51332026-03-03T18:57:07.477ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
51342026-03-03T18:57:07.479ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
51352026-03-03T18:57:07.479ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
51362026-03-03T18:57:07.479ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
51372026-03-03T18:57:07.479ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
51382026-03-03T18:57:07.481ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a920cd9c-e6dc-461a-9fec-4cee1418b6fa", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51392026-03-03T18:57:07.481ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=0
51402026-03-03T18:57:07.481ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51412026-03-03T18:57:07.483ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
51422026-03-03T18:57:07.483ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
51432026-03-03T18:57:07.483ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51442026-03-03T18:57:07.483ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51452026-03-03T18:57:07.484ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
51462026-03-03T18:57:07.484ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
51472026-03-03T18:57:07.484ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
51482026-03-03T18:57:07.484ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
51492026-03-03T18:57:07.486ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "593cfb40-f452-457f-b6d7-5246b601a7d1", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51502026-03-03T18:57:07.488ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=1
51512026-03-03T18:57:07.488ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa04d0d5-741a-4d54-9f93-0c39f57f7c91", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51522026-03-03T18:57:07.488ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=0
51532026-03-03T18:57:07.488ZINFOtest_metrics (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
51542026-03-03T18:57:07.488ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 95.218236ms iteration = 4 status = {"blueprint_id":"a34df21f-b47e-418a-ab97-8a520be16a04","inventory_collection_id":"20823b1e-db9e-40d4-a18e-a9543ccf5292","stats":{"crucible_dataset":{"num_already_exist":0,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
51552026-03-03T18:57:07.488ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b697f492-3091-49a3-addb-98a0bd3bff30", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51562026-03-03T18:57:07.488ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=1
51572026-03-03T18:57:07.488ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
51582026-03-03T18:57:07.488ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
51592026-03-03T18:57:07.488ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
51602026-03-03T18:57:07.488ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
51612026-03-03T18:57:07.488ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
51622026-03-03T18:57:07.489ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "64b7b494-84f1-4363-a36b-f720702237e7", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51632026-03-03T18:57:07.489ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cmpa
51642026-03-03T18:57:07.489ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
51652026-03-03T18:57:07.490ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
51662026-03-03T18:57:07.491ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
51672026-03-03T18:57:07.491ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 97.84624ms iteration = 4 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
51682026-03-03T18:57:07.492ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c35706d2-0dcd-4de9-9840-ec45c6f8be05", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51692026-03-03T18:57:07.492ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
51702026-03-03T18:57:07.493ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "132b5e9f-ed04-4151-b03a-e44546ddb8c2", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51712026-03-03T18:57:07.493ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
51722026-03-03T18:57:07.493ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "37722ffb-1737-42e2-a588-e0694defb37a", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51732026-03-03T18:57:07.493ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
51742026-03-03T18:57:07.494ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e3d1989-b8f9-452d-a24b-6c83bee9a97b", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51752026-03-03T18:57:07.494ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
51762026-03-03T18:57:07.494ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51772026-03-03T18:57:07.494ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
51782026-03-03T18:57:07.494ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51792026-03-03T18:57:07.494ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
51802026-03-03T18:57:07.495ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51812026-03-03T18:57:07.498ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
51822026-03-03T18:57:07.500ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
51832026-03-03T18:57:07.500ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51842026-03-03T18:57:07.500ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
51852026-03-03T18:57:07.500ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51862026-03-03T18:57:07.500ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
51872026-03-03T18:57:07.500ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51882026-03-03T18:57:07.503ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
51892026-03-03T18:57:07.503ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
51902026-03-03T18:57:07.503ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51912026-03-03T18:57:07.503ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
51922026-03-03T18:57:07.523ZDEBGtest_metrics (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:36085
51932026-03-03T18:57:07.523ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = http://[::1]:36085 background_task = inventory_collection body = None method = GET uri = http://[::1]:36085/inventory
51942026-03-03T18:57:07.523ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35814 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
51952026-03-03T18:57:07.523ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = GET remote_addr = [::1]:35814 req_id = 92ffce14-a22b-46c9-bb1f-24665160403e sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
51962026-03-03T18:57:07.523ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = GET remote_addr = [::1]:35814 req_id = 92ffce14-a22b-46c9-bb1f-24665160403e sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory version = 23.0.0
51972026-03-03T18:57:07.525ZINFOtest_metrics (dropshot): request completed latency_us = 1107 local_addr = [::1]:36085 method = GET remote_addr = [::1]:35814 req_id = 92ffce14-a22b-46c9-bb1f-24665160403e response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
51982026-03-03T18:57:07.525ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = http://[::1]:36085 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:36085/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "92ffce14-a22b-46c9-bb1f-24665160403e", "content-length": "21353", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
51992026-03-03T18:57:07.526ZDEBGtest_metrics (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
52002026-03-03T18:57:07.526ZDEBGtest_metrics (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
52012026-03-03T18:57:07.526ZDEBGtest_metrics (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
52022026-03-03T18:57:07.526ZDEBGtest_metrics (CockroachClusterAdminClient): client request body = None method = GET uri = http://[::1]:32222/node/id
52032026-03-03T18:57:07.526ZDEBGtest_metrics (CockroachClusterAdminClient): client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
52042026-03-03T18:57:07.526ZWARNtest_metrics (CockroachClusterAdminClient): Failed to fetch metrics from CockroachDB node error = Failed to get node ID from [::1]:32222
52052026-03-03T18:57:07.535ZDEBGtest_metrics (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[::1]:10123 zone_id = 128cd5ee-2d78-44f6-9fb4-83dda8b3d1a4 (omicron_zone)
52062026-03-03T18:57:07.535ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[::1]:10123 uri = http://[::1]:10123/timesync
52072026-03-03T18:57:07.535ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[::1]:10123 result = Err(reqwest::Error { kind: Request, url: "http://[::1]:10123/timesync", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:10123, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
52082026-03-03T18:57:07.536ZDEBGtest_metrics (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
52092026-03-03T18:57:07.544ZDEBGtest_metrics (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 2a83ee47-a98f-4924-a414-6bdba496b84f (omicron_zone)
52102026-03-03T18:57:07.544ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[::1]:34487 method = GET uri = http://[::1]:34487/config
52112026-03-03T18:57:07.544ZINFOtest_metrics (nexus): upserting zpool physical_disk_id = 533fa386-1c38-4fa8-b93e-c679c92c7584 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = 9ae7bc40-1cd5-400d-9ab1-bf7c1213617c
52122026-03-03T18:57:07.544ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52132026-03-03T18:57:07.544ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52142026-03-03T18:57:07.544ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52152026-03-03T18:57:07.545ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:34487 remote_addr = [::1]:39246
52162026-03-03T18:57:07.545ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:34487 method = GET remote_addr = [::1]:39246 req_id = d6f35d41-26e0-496e-ab34-f1860027fead uri = /config
52172026-03-03T18:57:07.545ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:34487 method = GET remote_addr = [::1]:39246 req_id = d6f35d41-26e0-496e-ab34-f1860027fead uri = /config version = 2.0.0
52182026-03-03T18:57:07.546ZINFOtest_metrics (http): request completed kind = dns latency_us = 555 local_addr = [::1]:34487 method = GET remote_addr = [::1]:39246 req_id = d6f35d41-26e0-496e-ab34-f1860027fead response_code = 200 uri = /config
52192026-03-03T18:57:07.546ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
52202026-03-03T18:57:07.546ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52212026-03-03T18:57:07.546ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52222026-03-03T18:57:07.546ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52232026-03-03T18:57:07.546ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52242026-03-03T18:57:07.547ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[::1]:34487 result = Ok(Response { url: "http://[::1]:34487/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6f35d41-26e0-496e-ab34-f1860027fead", "content-length": "3478", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
52252026-03-03T18:57:07.547ZDEBGtest_metrics (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 2a83ee47-a98f-4924-a414-6bdba496b84f (omicron_zone)
52262026-03-03T18:57:07.547ZDEBGtest_metrics (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
52272026-03-03T18:57:07.547ZDEBGtest_metrics (BackgroundTasks): finished collection background_task = inventory_collection
52282026-03-03T18:57:07.547ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
52292026-03-03T18:57:07.547ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52302026-03-03T18:57:07.547ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
52312026-03-03T18:57:07.547ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52322026-03-03T18:57:07.548ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
52332026-03-03T18:57:07.549ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52342026-03-03T18:57:07.552ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
52352026-03-03T18:57:07.552ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
52362026-03-03T18:57:07.552ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52372026-03-03T18:57:07.553ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
52382026-03-03T18:57:07.553ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52392026-03-03T18:57:07.555ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
52402026-03-03T18:57:07.559ZINFOtest_metrics (nexus): upserting Crucible dataset dataset_id = e8989f88-588d-46eb-a9e1-551a762b720c zpool_id = 9ae7bc40-1cd5-400d-9ab1-bf7c1213617c
52412026-03-03T18:57:07.564ZINFOtest_metrics (nexus): inserting test physical disk model = test-model physical_disk_id = 533fa386-1c38-4fa8-b93e-c679c92c7584 serial = totally-unique-serial: 533fa386-1c38-4fa8-b93e-c679c92c7584 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
52422026-03-03T18:57:07.564ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52432026-03-03T18:57:07.564ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52442026-03-03T18:57:07.564ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52452026-03-03T18:57:07.566ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = PhysicalDisk { parent: Fleet, key: 533fa386-1c38-4fa8-b93e-c679c92c7584 (physical_disk), lookup_type: ById(533fa386-1c38-4fa8-b93e-c679c92c7584) }
52462026-03-03T18:57:07.566ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52472026-03-03T18:57:07.566ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52482026-03-03T18:57:07.566ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52492026-03-03T18:57:07.566ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52502026-03-03T18:57:07.568ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52512026-03-03T18:57:07.577ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = PhysicalDisk { parent: Fleet, key: 533fa386-1c38-4fa8-b93e-c679c92c7584 (physical_disk), lookup_type: ById(533fa386-1c38-4fa8-b93e-c679c92c7584) } result = Ok(())
52522026-03-03T18:57:07.577ZINFOtest_metrics (nexus): upserting zpool physical_disk_id = 533fa386-1c38-4fa8-b93e-c679c92c7584 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = 9ae7bc40-1cd5-400d-9ab1-bf7c1213617c
52532026-03-03T18:57:07.577ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52542026-03-03T18:57:07.577ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52552026-03-03T18:57:07.577ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52562026-03-03T18:57:07.577ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
52572026-03-03T18:57:07.577ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52582026-03-03T18:57:07.577ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52592026-03-03T18:57:07.577ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52602026-03-03T18:57:07.577ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52612026-03-03T18:57:07.577ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52622026-03-03T18:57:07.578ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
52632026-03-03T18:57:07.581ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
52642026-03-03T18:57:07.581ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52652026-03-03T18:57:07.581ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52662026-03-03T18:57:07.581ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52672026-03-03T18:57:07.582ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52682026-03-03T18:57:07.583ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52692026-03-03T18:57:07.585ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
52702026-03-03T18:57:07.586ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52712026-03-03T18:57:07.586ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52722026-03-03T18:57:07.586ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52732026-03-03T18:57:07.587ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
52742026-03-03T18:57:07.588ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52752026-03-03T18:57:07.588ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52762026-03-03T18:57:07.588ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52772026-03-03T18:57:07.588ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52782026-03-03T18:57:07.589ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52792026-03-03T18:57:07.593ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
52802026-03-03T18:57:07.593ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52812026-03-03T18:57:07.593ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52822026-03-03T18:57:07.593ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52832026-03-03T18:57:07.648ZINFOtest_metrics (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 6990cabd-9b62-493f-b3c8-5aa30044cb51
52842026-03-03T18:57:07.648ZDEBGtest_metrics (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 6990cabd-9b62-493f-b3c8-5aa30044cb51 time_started = 2026-03-03 18:57:07.371406 UTC
52852026-03-03T18:57:07.648ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 310.447717ms iteration = 5 status = {"collection_id":"6990cabd-9b62-493f-b3c8-5aa30044cb51","time_done":"2026-03-03 18:57:07.547587 UTC","time_started":"2026-03-03 18:57:07.371406 UTC"}
52862026-03-03T18:57:07.649ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 6 reason = Signaled
52872026-03-03T18:57:07.649ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
52882026-03-03T18:57:07.649ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52892026-03-03T18:57:07.649ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
52902026-03-03T18:57:07.649ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52912026-03-03T18:57:07.649ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
52922026-03-03T18:57:07.650ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 5 reason = Dependency
52932026-03-03T18:57:07.650ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
52942026-03-03T18:57:07.650ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52952026-03-03T18:57:07.650ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
52962026-03-03T18:57:07.650ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
52972026-03-03T18:57:07.650ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
52982026-03-03T18:57:07.651ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52992026-03-03T18:57:07.654ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
53002026-03-03T18:57:07.654ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
53012026-03-03T18:57:07.654ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53022026-03-03T18:57:07.655ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
53032026-03-03T18:57:07.655ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53042026-03-03T18:57:07.658ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
53052026-03-03T18:57:07.658ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
53062026-03-03T18:57:07.659ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
53072026-03-03T18:57:07.659ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
53082026-03-03T18:57:07.659ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
53092026-03-03T18:57:07.659ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
53102026-03-03T18:57:07.660ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
53112026-03-03T18:57:07.660ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(7b82cae1-bfef-49b5-809c-5be3d97f2f81, 2), (7b3e1531-9e16-46a8-b395-70c01b6466c5, 2), (20823b1e-db9e-40d4-a18e-a9543ccf5292, 2), (6990cabd-9b62-493f-b3c8-5aa30044cb51, 2)] collection_id = 7b82cae1-bfef-49b5-809c-5be3d97f2f81
53122026-03-03T18:57:07.660ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
53132026-03-03T18:57:07.660ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53142026-03-03T18:57:07.661ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
53152026-03-03T18:57:07.661ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
53162026-03-03T18:57:07.661ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
53172026-03-03T18:57:07.661ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
53182026-03-03T18:57:07.686ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
53192026-03-03T18:57:07.686ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36599 method = GET path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
53202026-03-03T18:57:07.686ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36599 method = POST path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
53212026-03-03T18:57:07.686ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36599 method = DELETE path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
53222026-03-03T18:57:07.686ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36599 method = GET path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
53232026-03-03T18:57:07.686ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36599 method = GET path = /crucible/0/regions/{id}/snapshots server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
53242026-03-03T18:57:07.687ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36599 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
53252026-03-03T18:57:07.687ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36599 method = GET path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
53262026-03-03T18:57:07.687ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36599 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
53272026-03-03T18:57:07.687ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:36599 method = POST path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
53282026-03-03T18:57:07.687ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): listening kind = storage local_addr = [::1]:36599 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
53292026-03-03T18:57:07.687ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): successfully registered DTrace USDT probes kind = storage local_addr = [::1]:36599 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
53302026-03-03T18:57:07.687ZINFOtest_metrics (SledAgent): Created Simulated Crucible Server address = [::1]:36599 kind = storage server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
53312026-03-03T18:57:07.687ZINFOtest_metrics (nexus): inserting test physical disk model = test-model physical_disk_id = be5d0c35-1efc-42e6-b46a-13146cc505ba serial = totally-unique-serial: be5d0c35-1efc-42e6-b46a-13146cc505ba sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
53322026-03-03T18:57:07.687ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
53332026-03-03T18:57:07.687ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
53342026-03-03T18:57:07.687ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
53352026-03-03T18:57:07.688ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 38.231931ms iteration = 5 status = {"Loaded":{"collection_id":"6990cabd-9b62-493f-b3c8-5aa30044cb51","time_loaded":"2026-03-03T18:57:07.650196417Z","time_started":"2026-03-03T18:57:07.371406Z"}}
53362026-03-03T18:57:07.688ZDEBGtest_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Dependency
53372026-03-03T18:57:07.688ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 25.19\u{b5}s iteration = 5 status = {"error":"task disabled"}
53382026-03-03T18:57:07.688ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 5 reason = Dependency
53392026-03-03T18:57:07.688ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
53402026-03-03T18:57:07.688ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
53412026-03-03T18:57:07.688ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
53422026-03-03T18:57:07.688ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 7 reason = Dependency
53432026-03-03T18:57:07.688ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
53442026-03-03T18:57:07.688ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 14.49\u{b5}s iteration = 7 status = "Disabled"
53452026-03-03T18:57:07.688ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Dependency
53462026-03-03T18:57:07.688ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
53472026-03-03T18:57:07.689ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53482026-03-03T18:57:07.689ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
53492026-03-03T18:57:07.689ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53502026-03-03T18:57:07.689ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53512026-03-03T18:57:07.690ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 1f 72 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .r..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:14071 req_id = fdbef435-8857-495d-a523-9c28a4b8452c
53522026-03-03T18:57:07.690ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 8050,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:14071 req_id = fdbef435-8857-495d-a523-9c28a4b8452c
53532026-03-03T18:57:07.690ZDEBGtest_metrics (store): query key key = _dendrite._tcp
53542026-03-03T18:57:07.690ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
53552026-03-03T18:57:07.690ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:14071 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = fdbef435-8857-495d-a523-9c28a4b8452c
53562026-03-03T18:57:07.690ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1964, tv_nsec: 955488919 } })
53572026-03-03T18:57:07.690ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
53582026-03-03T18:57:07.691ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: c0 8a 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:11296 req_id = b66a96b9-fddb-415a-800e-975e62d75cef
53592026-03-03T18:57:07.691ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 49290,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:11296 req_id = b66a96b9-fddb-415a-800e-975e62d75cef
53602026-03-03T18:57:07.691ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
53612026-03-03T18:57:07.691ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:11296 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = b66a96b9-fddb-415a-800e-975e62d75cef
53622026-03-03T18:57:07.691ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53632026-03-03T18:57:07.694ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
53642026-03-03T18:57:07.694ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
53652026-03-03T18:57:07.694ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53662026-03-03T18:57:07.694ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
53672026-03-03T18:57:07.694ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53682026-03-03T18:57:07.694ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53692026-03-03T18:57:07.695ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
53702026-03-03T18:57:07.695ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
53712026-03-03T18:57:07.695ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
53722026-03-03T18:57:07.713ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:34679/switch/identifiers
53732026-03-03T18:57:07.714ZINFOtest_metrics (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 7b82cae1-bfef-49b5-809c-5be3d97f2f81 nboot_partitions = 2 ncabooses = 24 nclickhouse_keeper_membership = 0 ncockroach_status = 0 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 7 nerrors = 2 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 1 nlast_reconciliation_dataset_results = 7 nlast_reconciliation_disk_results = 10 nlast_reconciliation_measurements = 2 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 7 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 0 nnvme_disk_firmware = 0 nomicron_sled_config_datasets = 7 nomicron_sled_config_disks = 10 nomicron_sled_config_zone_nics = 3 nomicron_sled_config_zones = 7 nomicron_sled_configs = 1 nphysical_disks = 0 nrot_pages = 16 nrots = 4 nsled_agents = 1 nsps = 4 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 0
53742026-03-03T18:57:07.714ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
53752026-03-03T18:57:07.714ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53762026-03-03T18:57:07.714ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
53772026-03-03T18:57:07.715ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:34679/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd70f8f7-ccbf-45a7-a5a9-85136c5f4d9d", "content-length": "206", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
53782026-03-03T18:57:07.715ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
53792026-03-03T18:57:07.715ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
53802026-03-03T18:57:07.715ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
53812026-03-03T18:57:07.716ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
53822026-03-03T18:57:07.716ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53832026-03-03T18:57:07.719ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
53842026-03-03T18:57:07.719ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
53852026-03-03T18:57:07.719ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53862026-03-03T18:57:07.720ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53872026-03-03T18:57:07.720ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(7b3e1531-9e16-46a8-b395-70c01b6466c5, 2), (20823b1e-db9e-40d4-a18e-a9543ccf5292, 2), (6990cabd-9b62-493f-b3c8-5aa30044cb51, 2)]
53882026-03-03T18:57:07.720ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
53892026-03-03T18:57:07.720ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
53902026-03-03T18:57:07.720ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53912026-03-03T18:57:07.720ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
53922026-03-03T18:57:07.720ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
53932026-03-03T18:57:07.721ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
53942026-03-03T18:57:07.721ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
53952026-03-03T18:57:07.721ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53962026-03-03T18:57:07.721ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
53972026-03-03T18:57:07.721ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53982026-03-03T18:57:07.721ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53992026-03-03T18:57:07.722ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
54002026-03-03T18:57:07.722ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
54012026-03-03T18:57:07.722ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
54022026-03-03T18:57:07.722ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
54032026-03-03T18:57:07.722ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
54042026-03-03T18:57:07.722ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: b9 e1 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:5273 req_id = 2b1a4a45-4265-4e2d-aad3-5ceb204ac626
54052026-03-03T18:57:07.723ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 47585,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:5273 req_id = 2b1a4a45-4265-4e2d-aad3-5ceb204ac626
54062026-03-03T18:57:07.723ZDEBGtest_metrics (store): query key key = _mgs._tcp
54072026-03-03T18:57:07.723ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
54082026-03-03T18:57:07.723ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:5273 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42517, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 2b1a4a45-4265-4e2d-aad3-5ceb204ac626
54092026-03-03T18:57:07.723ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54102026-03-03T18:57:07.726ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54112026-03-03T18:57:07.726ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
54122026-03-03T18:57:07.726ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54132026-03-03T18:57:07.726ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
54142026-03-03T18:57:07.726ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54152026-03-03T18:57:07.726ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54162026-03-03T18:57:07.726ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
54172026-03-03T18:57:07.726ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
54182026-03-03T18:57:07.726ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
54192026-03-03T18:57:07.726ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
54202026-03-03T18:57:07.727ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
54212026-03-03T18:57:07.727ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42517, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1964, tv_nsec: 992348658 } })
54222026-03-03T18:57:07.727ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
54232026-03-03T18:57:07.728ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54242026-03-03T18:57:07.730ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
54252026-03-03T18:57:07.731ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54262026-03-03T18:57:07.733ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54272026-03-03T18:57:07.733ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
54282026-03-03T18:57:07.733ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54292026-03-03T18:57:07.734ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54302026-03-03T18:57:07.734ZINFOtest_metrics (nexus): upserting zpool physical_disk_id = be5d0c35-1efc-42e6-b46a-13146cc505ba sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = 4663ee77-faf7-484d-b93c-0f9d30febdf8
54312026-03-03T18:57:07.734ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
54322026-03-03T18:57:07.734ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
54332026-03-03T18:57:07.734ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
54342026-03-03T18:57:07.735ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: ee 40 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .@..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:34137 req_id = 6817ff30-7bca-48ed-83cd-0ef856b27f7f
54352026-03-03T18:57:07.735ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 60992,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:34137 req_id = 6817ff30-7bca-48ed-83cd-0ef856b27f7f
54362026-03-03T18:57:07.735ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
54372026-03-03T18:57:07.735ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:34137 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 6817ff30-7bca-48ed-83cd-0ef856b27f7f
54382026-03-03T18:57:07.744ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
54392026-03-03T18:57:07.744ZINFOtest_metrics (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous num_already_exist = 0 num_inserted = 0 num_not_in_inventory = 0
54402026-03-03T18:57:07.744ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
54412026-03-03T18:57:07.744ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54422026-03-03T18:57:07.744ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
54432026-03-03T18:57:07.744ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54442026-03-03T18:57:07.745ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54452026-03-03T18:57:07.746ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
54462026-03-03T18:57:07.746ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54472026-03-03T18:57:07.746ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
54482026-03-03T18:57:07.746ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
54492026-03-03T18:57:07.746ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
54502026-03-03T18:57:07.746ZTRACtest_metrics (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: ff cd 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:64767 req_id = e8984c3e-be53-40d1-9466-89904db37c32
54512026-03-03T18:57:07.747ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 65485,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:64767 req_id = e8984c3e-be53-40d1-9466-89904db37c32
54522026-03-03T18:57:07.747ZDEBGtest_metrics (store): query key key = _clickhouse-admin-keeper._tcp
54532026-03-03T18:57:07.747ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 65485, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal kind = dns peer_addr = [::1]:64767 req_id = e8984c3e-be53-40d1-9466-89904db37c32
54542026-03-03T18:57:07.747ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal
54552026-03-03T18:57:07.747ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54562026-03-03T18:57:07.750ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54572026-03-03T18:57:07.750ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
54582026-03-03T18:57:07.750ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54592026-03-03T18:57:07.750ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
54602026-03-03T18:57:07.750ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54612026-03-03T18:57:07.750ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54622026-03-03T18:57:07.751ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632026-03-03T18:57:07.753ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
54642026-03-03T18:57:07.753ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
54652026-03-03T18:57:07.753ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
54662026-03-03T18:57:07.753ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
54672026-03-03T18:57:07.753ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
54682026-03-03T18:57:07.753ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
54692026-03-03T18:57:07.754ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54702026-03-03T18:57:07.756ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54712026-03-03T18:57:07.756ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
54722026-03-03T18:57:07.756ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54732026-03-03T18:57:07.757ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54742026-03-03T18:57:07.757ZINFOtest_metrics (nexus): upserting Crucible dataset dataset_id = f1c18a48-e3ab-4505-8dc5-08936c973d7a zpool_id = 4663ee77-faf7-484d-b93c-0f9d30febdf8
54752026-03-03T18:57:07.757ZTRACtest_metrics (dns): buffer buffer = Length: 73 (0x49) bytes\n0000: 8d 8d 01 00 00 01 00 00 00 00 00 01 0a 5f 63 6f ............._co\n0010: 63 6b 72 6f 61 63 68 04 5f 74 63 70 0d 63 6f 6e ckroach._tcp.con\n0020: 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 trol-plane.oxide\n0030: 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 .internal..!....\n0040: 29 04 d0 00 00 00 00 00 00 )........ kind = dns peer_addr = [::1]:45009 req_id = 04a05825-22ad-46c0-8232-3c9937e676f2
54762026-03-03T18:57:07.757ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 36237,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_cockroach._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_cockroach._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:45009 req_id = 04a05825-22ad-46c0-8232-3c9937e676f2
54772026-03-03T18:57:07.758ZDEBGtest_metrics (store): query key key = _cockroach._tcp
54782026-03-03T18:57:07.758ZDEBGtest_metrics (store): query key key = 8b178ee8-bb89-4436-88d8-e2f462915df4.host
54792026-03-03T18:57:07.758ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:45009 query = LowerQuery { name: LowerName(Name("_cockroach._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43291, target: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal") }) }] req_id = 04a05825-22ad-46c0-8232-3c9937e676f2
54802026-03-03T18:57:07.760ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43291, target: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1965, tv_nsec: 24930391 } })
54812026-03-03T18:57:07.760ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
54822026-03-03T18:57:07.760ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 58 fa 01 00 00 01 00 00 00 00 00 01 24 38 62 31 X...........$8b1\n0010: 37 38 65 65 38 2d 62 62 38 39 2d 34 34 33 36 2d 78ee8-bb89-4436-\n0020: 38 38 64 38 2d 65 32 66 34 36 32 39 31 35 64 66 88d8-e2f462915df\n0030: 34 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 4.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:23496 req_id = 821a32c9-7cff-4284-adfd-cf196a0fae68
54832026-03-03T18:57:07.760ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 22778,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 56,\n 98,\n 49,\n 55,\n 56,\n 101,\n 101,\n 56,\n 45,\n 98,\n 98,\n 56,\n 57,\n 45,\n 52,\n 52,\n 51,\n 54,\n 45,\n 56,\n 56,\n 100,\n 56,\n 45,\n 101,\n 50,\n 102,\n 52,\n 54,\n 50,\n 57,\n 49,\n 53,\n 100,\n 102,\n 52,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:23496 req_id = 821a32c9-7cff-4284-adfd-cf196a0fae68
54842026-03-03T18:57:07.760ZDEBGtest_metrics (store): query key key = 8b178ee8-bb89-4436-88d8-e2f462915df4.host
54852026-03-03T18:57:07.761ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:23496 query = LowerQuery { name: LowerName(Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal.")), original: Query { name: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 821a32c9-7cff-4284-adfd-cf196a0fae68
54862026-03-03T18:57:07.761ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
54872026-03-03T18:57:07.761ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
54882026-03-03T18:57:07.761ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
54892026-03-03T18:57:07.761ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
54902026-03-03T18:57:07.762ZINFOtest_metrics (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
54912026-03-03T18:57:07.762ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
54922026-03-03T18:57:07.762ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54932026-03-03T18:57:07.762ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
54942026-03-03T18:57:07.762ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54952026-03-03T18:57:07.762ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54962026-03-03T18:57:07.762ZINFOtest_metrics (nexus): inserting test physical disk model = test-model physical_disk_id = be5d0c35-1efc-42e6-b46a-13146cc505ba serial = totally-unique-serial: be5d0c35-1efc-42e6-b46a-13146cc505ba sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
54972026-03-03T18:57:07.762ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
54982026-03-03T18:57:07.762ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
54992026-03-03T18:57:07.763ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
55002026-03-03T18:57:07.763ZDEBGtest_metrics (BackgroundTasks): begin collection background_task = inventory_collection
55012026-03-03T18:57:07.763ZDEBGtest_metrics (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:42517
55022026-03-03T18:57:07.763ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/ignition
55032026-03-03T18:57:07.764ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55042026-03-03T18:57:07.767ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
55052026-03-03T18:57:07.767ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
55062026-03-03T18:57:07.767ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
55072026-03-03T18:57:07.767ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
55082026-03-03T18:57:07.767ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
55092026-03-03T18:57:07.768ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
55102026-03-03T18:57:07.768ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
55112026-03-03T18:57:07.768ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
55122026-03-03T18:57:07.768ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
55132026-03-03T18:57:07.768ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
55142026-03-03T18:57:07.768ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
55152026-03-03T18:57:07.769ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = PhysicalDisk { parent: Fleet, key: be5d0c35-1efc-42e6-b46a-13146cc505ba (physical_disk), lookup_type: ById(be5d0c35-1efc-42e6-b46a-13146cc505ba) }
55162026-03-03T18:57:07.769ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
55172026-03-03T18:57:07.769ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
55182026-03-03T18:57:07.769ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
55192026-03-03T18:57:07.769ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
55202026-03-03T18:57:07.769ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55212026-03-03T18:57:07.772ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
55222026-03-03T18:57:07.772ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
55232026-03-03T18:57:07.772ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
55242026-03-03T18:57:07.772ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
55252026-03-03T18:57:07.773ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
55262026-03-03T18:57:07.773ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
55272026-03-03T18:57:07.774ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
55282026-03-03T18:57:07.774ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 86.148568ms iteration = 5 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
55292026-03-03T18:57:07.775ZINFOtest_metrics (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
55302026-03-03T18:57:07.775ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 86.962429ms iteration = 5 status = {"blueprint_id":"a34df21f-b47e-418a-ab97-8a520be16a04","inventory_collection_id":"6990cabd-9b62-493f-b3c8-5aa30044cb51","stats":{"crucible_dataset":{"num_already_exist":0,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
55312026-03-03T18:57:07.776ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4468d68-6fe8-4ff2-89f2-40975c43dbed", "content-length": "835", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55322026-03-03T18:57:07.776ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0
55332026-03-03T18:57:07.776ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55342026-03-03T18:57:07.780ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = PhysicalDisk { parent: Fleet, key: be5d0c35-1efc-42e6-b46a-13146cc505ba (physical_disk), lookup_type: ById(be5d0c35-1efc-42e6-b46a-13146cc505ba) } result = Ok(())
55352026-03-03T18:57:07.780ZINFOtest_metrics (nexus): upserting zpool physical_disk_id = be5d0c35-1efc-42e6-b46a-13146cc505ba sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = 4663ee77-faf7-484d-b93c-0f9d30febdf8
55362026-03-03T18:57:07.780ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
55372026-03-03T18:57:07.780ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
55382026-03-03T18:57:07.780ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
55392026-03-03T18:57:07.781ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
55402026-03-03T18:57:07.781ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
55412026-03-03T18:57:07.782ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
55422026-03-03T18:57:07.782ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
55432026-03-03T18:57:07.782ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
55442026-03-03T18:57:07.782ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "128899b7-6d7e-45f8-9a80-c5f5a9bb703f", "content-length": "734", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55452026-03-03T18:57:07.782ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=0
55462026-03-03T18:57:07.783ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6309fa51-072e-42ed-8ab9-c34a231dd64a", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55472026-03-03T18:57:07.786ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=1
55482026-03-03T18:57:07.786ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55492026-03-03T18:57:07.786ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
55502026-03-03T18:57:07.786ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1307eba0-5659-4e63-8176-1f01dc0ac998", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55512026-03-03T18:57:07.786ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=0
55522026-03-03T18:57:07.787ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b9743a3-8792-496e-910d-26b4903d6f46", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55532026-03-03T18:57:07.788ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=1
55542026-03-03T18:57:07.788ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ce54eef-e0f7-4ae5-9af7-5d7830a72e8e", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55552026-03-03T18:57:07.788ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=0
55562026-03-03T18:57:07.788ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
55572026-03-03T18:57:07.788ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
55582026-03-03T18:57:07.788ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
55592026-03-03T18:57:07.788ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
55602026-03-03T18:57:07.788ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
55612026-03-03T18:57:07.789ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae3ea706-4c70-41cb-945a-0e108216da61", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55622026-03-03T18:57:07.791ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=1
55632026-03-03T18:57:07.791ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55642026-03-03T18:57:07.792ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
55652026-03-03T18:57:07.794ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
55662026-03-03T18:57:07.794ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
55672026-03-03T18:57:07.794ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
55682026-03-03T18:57:07.794ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "abec5a42-7cc6-405e-9e7d-25b5b0c83436", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55692026-03-03T18:57:07.794ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cmpa
55702026-03-03T18:57:07.794ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c1ab1e8-6c4a-4f8b-a4ac-be59127d3c29", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55712026-03-03T18:57:07.794ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
55722026-03-03T18:57:07.794ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
55732026-03-03T18:57:07.794ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
55742026-03-03T18:57:07.794ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
55752026-03-03T18:57:07.794ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
55762026-03-03T18:57:07.794ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
55772026-03-03T18:57:07.795ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4db507e-547d-4014-843b-de2891ed4968", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55782026-03-03T18:57:07.795ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
55792026-03-03T18:57:07.796ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "01bdcbd7-4354-476f-8639-d438f2f42f99", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55802026-03-03T18:57:07.796ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
55812026-03-03T18:57:07.796ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55822026-03-03T18:57:07.801ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
55832026-03-03T18:57:07.801ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
55842026-03-03T18:57:07.801ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
55852026-03-03T18:57:07.801ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
55862026-03-03T18:57:07.802ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a9fa549-c68f-4bea-abd6-8d1e1934343e", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55872026-03-03T18:57:07.802ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1
55882026-03-03T18:57:07.802ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b76cfdb7-e3e8-4eff-9f65-757c212134a3", "content-length": "734", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55892026-03-03T18:57:07.803ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=0
55902026-03-03T18:57:07.803ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fd214fc-d407-4786-b0ca-1b16965fd485", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55912026-03-03T18:57:07.804ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=1
55922026-03-03T18:57:07.804ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
55932026-03-03T18:57:07.804ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
55942026-03-03T18:57:07.805ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
55952026-03-03T18:57:07.805ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e210d841-cf9f-42a4-a158-e62f4fa96d79", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55962026-03-03T18:57:07.805ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=0
55972026-03-03T18:57:07.806ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "638c19c4-671c-4f8a-a828-6f40d5639047", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
55982026-03-03T18:57:07.808ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=1
55992026-03-03T18:57:07.808ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "da78531d-57d6-4425-a309-c12d0c2ea488", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56002026-03-03T18:57:07.808ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=0
56012026-03-03T18:57:07.808ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f371e5d-1b50-40a4-916b-5a68ea353afc", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56022026-03-03T18:57:07.808ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=1
56032026-03-03T18:57:07.808ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6908b4ae-466a-4765-87fc-1f431f8c05c7", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56042026-03-03T18:57:07.808ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cmpa
56052026-03-03T18:57:07.809ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6b8bfb7-7341-49cd-9056-1ac51c2f093e", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56062026-03-03T18:57:07.811ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
56072026-03-03T18:57:07.811ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "edc05a8f-ca09-4802-804b-5a855e623909", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56082026-03-03T18:57:07.811ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
56092026-03-03T18:57:07.811ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "71806421-09ab-4da0-ba5e-45ab06b04206", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56102026-03-03T18:57:07.811ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
56112026-03-03T18:57:07.811ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ac4589e-9374-4e26-8b44-48d94e04f77a", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56122026-03-03T18:57:07.811ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0
56132026-03-03T18:57:07.811ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca604840-0cbb-412a-aee9-42b990f05cb8", "content-length": "723", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56142026-03-03T18:57:07.811ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/active-slot
56152026-03-03T18:57:07.812ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "c33d29ae-b33f-4baa-ba3f-48f2e01e5f1f", "content-length": "10", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56162026-03-03T18:57:07.812ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/0
56172026-03-03T18:57:07.812ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b17a69db-e8b0-48b2-a065-7e408b7139fb", "content-length": "144", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56182026-03-03T18:57:07.813ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/1
56192026-03-03T18:57:07.813ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "23a9810d-b654-4823-9b7e-8bcc0b049fe4", "content-length": "147", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56202026-03-03T18:57:07.813ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=0
56212026-03-03T18:57:07.814ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "400ce479-2254-4931-a475-e029e8a6932c", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56222026-03-03T18:57:07.814ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=1
56232026-03-03T18:57:07.815ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb40a060-71d9-4446-a5a0-060f0b00d6bf", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56242026-03-03T18:57:07.815ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=0
56252026-03-03T18:57:07.815ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd37c671-353d-423e-b7e5-b0b6db8e35a2", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56262026-03-03T18:57:07.816ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=1
56272026-03-03T18:57:07.816ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1aec21f3-b5c8-4cf2-ab0b-6b26572e01a1", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56282026-03-03T18:57:07.816ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=0
56292026-03-03T18:57:07.817ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "19a56dcc-91ac-477c-8884-86034f1ac2b4", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56302026-03-03T18:57:07.817ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=1
56312026-03-03T18:57:07.818ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "229dc78e-753c-430d-84ed-94840146c11d", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56322026-03-03T18:57:07.818ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cmpa
56332026-03-03T18:57:07.818ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0823dcf3-e556-4819-bae0-2da623a5b8ee", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56342026-03-03T18:57:07.818ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
56352026-03-03T18:57:07.819ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c4c31d9-7a72-44a2-8664-bfa4397b16d0", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56362026-03-03T18:57:07.819ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
56372026-03-03T18:57:07.820ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "175fad4c-aa33-47ee-af84-1da2456cb5eb", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56382026-03-03T18:57:07.820ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
56392026-03-03T18:57:07.820ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc6a7ffa-e78d-47f8-9a98-89d6abb50432", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56402026-03-03T18:57:07.820ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1
56412026-03-03T18:57:07.821ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6911dc5e-6700-4a50-a3bc-7dedd56e179e", "content-length": "723", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56422026-03-03T18:57:07.821ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/active-slot
56432026-03-03T18:57:07.822ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "d498b961-064b-4be4-bcfc-017528ff45c3", "content-length": "10", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56442026-03-03T18:57:07.822ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/0
56452026-03-03T18:57:07.822ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "71fce95f-e093-4c1d-bb81-05c416da3784", "content-length": "144", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56462026-03-03T18:57:07.823ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/1
56472026-03-03T18:57:07.823ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f02b541-a01f-4ec1-aefc-aaf39f14333b", "content-length": "147", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56482026-03-03T18:57:07.823ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=0
56492026-03-03T18:57:07.824ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2380a6f6-c9e8-4268-a6c0-a2e6bdfa08f0", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56502026-03-03T18:57:07.824ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=1
56512026-03-03T18:57:07.825ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f067c26e-5c6a-4822-8e4a-74fb921e5407", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56522026-03-03T18:57:07.825ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=0
56532026-03-03T18:57:07.825ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d69f9f3a-26c9-483f-9754-6c3a38ebfa69", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56542026-03-03T18:57:07.826ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=1
56552026-03-03T18:57:07.826ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8a7d9cb-7661-4edb-a9d3-f21c0894eabe", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56562026-03-03T18:57:07.826ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=0
56572026-03-03T18:57:07.827ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdea345c-465f-4841-a6e4-2b86eab00bf3", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56582026-03-03T18:57:07.827ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=1
56592026-03-03T18:57:07.828ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bea30fe8-bfb9-4a7b-a3be-6b363fa5cf6b", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56602026-03-03T18:57:07.828ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cmpa
56612026-03-03T18:57:07.828ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "16f181f4-87f4-4b32-9909-30543a206d10", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56622026-03-03T18:57:07.828ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
56632026-03-03T18:57:07.829ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cce9c2a-2368-41f0-9fa4-35bc4bd68fe1", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56642026-03-03T18:57:07.829ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
56652026-03-03T18:57:07.830ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "de2bc5d7-b3c6-476d-9ca6-e0c674ab2b0f", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56662026-03-03T18:57:07.830ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
56672026-03-03T18:57:07.830ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "db21ffa4-f9e0-4727-b1c0-ffe63b15dcdd", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56682026-03-03T18:57:07.830ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
56692026-03-03T18:57:07.830ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
56702026-03-03T18:57:07.831ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
56712026-03-03T18:57:07.831ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56722026-03-03T18:57:07.831ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
56732026-03-03T18:57:07.832ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
56742026-03-03T18:57:07.833ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56752026-03-03T18:57:07.836ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
56762026-03-03T18:57:07.836ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
56772026-03-03T18:57:07.836ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
56782026-03-03T18:57:07.836ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
56792026-03-03T18:57:07.836ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56802026-03-03T18:57:07.836ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
56812026-03-03T18:57:07.838ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56822026-03-03T18:57:07.841ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
56832026-03-03T18:57:07.841ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
56842026-03-03T18:57:07.841ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56852026-03-03T18:57:07.841ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
56862026-03-03T18:57:07.852ZDEBGtest_metrics (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:36085
56872026-03-03T18:57:07.852ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = http://[::1]:36085 background_task = inventory_collection body = None method = GET uri = http://[::1]:36085/inventory
56882026-03-03T18:57:07.853ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35816 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
56892026-03-03T18:57:07.853ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = GET remote_addr = [::1]:35816 req_id = c3f6c6de-ae7f-4cd2-8990-8e37505b4f97 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
56902026-03-03T18:57:07.853ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = GET remote_addr = [::1]:35816 req_id = c3f6c6de-ae7f-4cd2-8990-8e37505b4f97 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory version = 23.0.0
56912026-03-03T18:57:07.854ZINFOtest_metrics (dropshot): request completed latency_us = 1120 local_addr = [::1]:36085 method = GET remote_addr = [::1]:35816 req_id = c3f6c6de-ae7f-4cd2-8990-8e37505b4f97 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
56922026-03-03T18:57:07.854ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = http://[::1]:36085 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:36085/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3f6c6de-ae7f-4cd2-8990-8e37505b4f97", "content-length": "21727", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
56932026-03-03T18:57:07.855ZDEBGtest_metrics (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
56942026-03-03T18:57:07.856ZDEBGtest_metrics (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
56952026-03-03T18:57:07.856ZDEBGtest_metrics (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
56962026-03-03T18:57:07.856ZDEBGtest_metrics (CockroachClusterAdminClient): client request body = None method = GET uri = http://[::1]:32222/node/id
56972026-03-03T18:57:07.856ZDEBGtest_metrics (CockroachClusterAdminClient): client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
56982026-03-03T18:57:07.856ZWARNtest_metrics (CockroachClusterAdminClient): Failed to fetch metrics from CockroachDB node error = Failed to get node ID from [::1]:32222
56992026-03-03T18:57:07.865ZDEBGtest_metrics (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[::1]:10123 zone_id = 128cd5ee-2d78-44f6-9fb4-83dda8b3d1a4 (omicron_zone)
57002026-03-03T18:57:07.865ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[::1]:10123 uri = http://[::1]:10123/timesync
57012026-03-03T18:57:07.865ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[::1]:10123 result = Err(reqwest::Error { kind: Request, url: "http://[::1]:10123/timesync", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:10123, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
57022026-03-03T18:57:07.865ZDEBGtest_metrics (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
57032026-03-03T18:57:07.873ZDEBGtest_metrics (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 2a83ee47-a98f-4924-a414-6bdba496b84f (omicron_zone)
57042026-03-03T18:57:07.873ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[::1]:34487 method = GET uri = http://[::1]:34487/config
57052026-03-03T18:57:07.873ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:34487 remote_addr = [::1]:39248
57062026-03-03T18:57:07.874ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:34487 method = GET remote_addr = [::1]:39248 req_id = b112faf2-3daf-43ae-9e2d-0be74a839d9a uri = /config
57072026-03-03T18:57:07.874ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:34487 method = GET remote_addr = [::1]:39248 req_id = b112faf2-3daf-43ae-9e2d-0be74a839d9a uri = /config version = 2.0.0
57082026-03-03T18:57:07.874ZINFOtest_metrics (http): request completed kind = dns latency_us = 520 local_addr = [::1]:34487 method = GET remote_addr = [::1]:39248 req_id = b112faf2-3daf-43ae-9e2d-0be74a839d9a response_code = 200 uri = /config
57092026-03-03T18:57:07.874ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[::1]:34487 result = Ok(Response { url: "http://[::1]:34487/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b112faf2-3daf-43ae-9e2d-0be74a839d9a", "content-length": "3478", "date": "Tue, 03 Mar 2026 18:57:07 GMT"} })
57102026-03-03T18:57:07.875ZDEBGtest_metrics (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 2a83ee47-a98f-4924-a414-6bdba496b84f (omicron_zone)
57112026-03-03T18:57:07.875ZDEBGtest_metrics (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
57122026-03-03T18:57:07.875ZDEBGtest_metrics (BackgroundTasks): finished collection background_task = inventory_collection
57132026-03-03T18:57:07.875ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
57142026-03-03T18:57:07.875ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
57152026-03-03T18:57:07.875ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
57162026-03-03T18:57:07.875ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
57172026-03-03T18:57:07.875ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
57182026-03-03T18:57:07.877ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57192026-03-03T18:57:07.880ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
57202026-03-03T18:57:07.880ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
57212026-03-03T18:57:07.880ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
57222026-03-03T18:57:07.881ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
57232026-03-03T18:57:07.888ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
57242026-03-03T18:57:07.888ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
57252026-03-03T18:57:07.888ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
57262026-03-03T18:57:07.888ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
57272026-03-03T18:57:07.888ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
57282026-03-03T18:57:07.888ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57292026-03-03T18:57:07.892ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
57302026-03-03T18:57:07.892ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
57312026-03-03T18:57:07.892ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
57322026-03-03T18:57:07.892ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
57332026-03-03T18:57:07.893ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
57342026-03-03T18:57:07.893ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
57352026-03-03T18:57:07.894ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
57362026-03-03T18:57:07.924ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
57372026-03-03T18:57:07.975ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
57382026-03-03T18:57:07.975ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
57392026-03-03T18:57:07.975ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
57402026-03-03T18:57:07.975ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
57412026-03-03T18:57:07.976ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
57422026-03-03T18:57:07.977ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57432026-03-03T18:57:07.983ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
57442026-03-03T18:57:07.983ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
57452026-03-03T18:57:07.983ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
57462026-03-03T18:57:07.983ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
57472026-03-03T18:57:08.033ZINFOtest_metrics (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = d1dc7331-a864-454e-8158-4de36b53c8fd
57482026-03-03T18:57:08.034ZDEBGtest_metrics (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = d1dc7331-a864-454e-8158-4de36b53c8fd time_started = 2026-03-03 18:57:07.763643 UTC
57492026-03-03T18:57:08.034ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 385.242976ms iteration = 6 status = {"collection_id":"d1dc7331-a864-454e-8158-4de36b53c8fd","time_done":"2026-03-03 18:57:07.875244 UTC","time_started":"2026-03-03 18:57:07.763643 UTC"}
57502026-03-03T18:57:08.034ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 7 reason = Signaled
57512026-03-03T18:57:08.034ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
57522026-03-03T18:57:08.034ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
57532026-03-03T18:57:08.034ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
57542026-03-03T18:57:08.034ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
57552026-03-03T18:57:08.035ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
57562026-03-03T18:57:08.035ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 6 reason = Dependency
57572026-03-03T18:57:08.035ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
57582026-03-03T18:57:08.035ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
57592026-03-03T18:57:08.035ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
57602026-03-03T18:57:08.035ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
57612026-03-03T18:57:08.036ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
57622026-03-03T18:57:08.036ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
57632026-03-03T18:57:08.036ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
57642026-03-03T18:57:08.037ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
57652026-03-03T18:57:08.037ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57662026-03-03T18:57:08.042ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
57672026-03-03T18:57:08.042ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
57682026-03-03T18:57:08.042ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
57692026-03-03T18:57:08.042ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
57702026-03-03T18:57:08.042ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57712026-03-03T18:57:08.051ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
57722026-03-03T18:57:08.051ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
57732026-03-03T18:57:08.051ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
57742026-03-03T18:57:08.051ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
57752026-03-03T18:57:08.051ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(7b3e1531-9e16-46a8-b395-70c01b6466c5, 2), (20823b1e-db9e-40d4-a18e-a9543ccf5292, 2), (6990cabd-9b62-493f-b3c8-5aa30044cb51, 2), (d1dc7331-a864-454e-8158-4de36b53c8fd, 2)] collection_id = 7b3e1531-9e16-46a8-b395-70c01b6466c5
57762026-03-03T18:57:08.051ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
57772026-03-03T18:57:08.051ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
57782026-03-03T18:57:08.051ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
57792026-03-03T18:57:08.051ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
57802026-03-03T18:57:08.051ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
57812026-03-03T18:57:08.051ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
57822026-03-03T18:57:08.055ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
57832026-03-03T18:57:08.055ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
57842026-03-03T18:57:08.090ZINFOtest_metrics (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 7b3e1531-9e16-46a8-b395-70c01b6466c5 nboot_partitions = 2 ncabooses = 24 nclickhouse_keeper_membership = 0 ncockroach_status = 0 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 7 nerrors = 2 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 1 nlast_reconciliation_dataset_results = 7 nlast_reconciliation_disk_results = 10 nlast_reconciliation_measurements = 2 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 7 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 0 nnvme_disk_firmware = 0 nomicron_sled_config_datasets = 7 nomicron_sled_config_disks = 10 nomicron_sled_config_zone_nics = 3 nomicron_sled_config_zones = 7 nomicron_sled_configs = 1 nphysical_disks = 0 nrot_pages = 16 nrots = 4 nsled_agents = 1 nsps = 4 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 0
57852026-03-03T18:57:08.090ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
57862026-03-03T18:57:08.090ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
57872026-03-03T18:57:08.090ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
57882026-03-03T18:57:08.093ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(20823b1e-db9e-40d4-a18e-a9543ccf5292, 2), (6990cabd-9b62-493f-b3c8-5aa30044cb51, 2), (d1dc7331-a864-454e-8158-4de36b53c8fd, 2)]
57892026-03-03T18:57:08.093ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
57902026-03-03T18:57:08.094ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: f8 99 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:65345 req_id = 3a34bf03-15a4-4188-a568-3de4bf61c2ba
57912026-03-03T18:57:08.094ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 63641,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:65345 req_id = 3a34bf03-15a4-4188-a568-3de4bf61c2ba
57922026-03-03T18:57:08.094ZDEBGtest_metrics (store): query key key = _mgs._tcp
57932026-03-03T18:57:08.094ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
57942026-03-03T18:57:08.094ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:65345 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42517, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 3a34bf03-15a4-4188-a568-3de4bf61c2ba
57952026-03-03T18:57:08.094ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42517, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1965, tv_nsec: 359282626 } })
57962026-03-03T18:57:08.094ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
57972026-03-03T18:57:08.094ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 62 95 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e b...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:51160 req_id = fc5ba2e9-c643-4e15-8033-4511ff810e10
57982026-03-03T18:57:08.094ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 25237,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:51160 req_id = fc5ba2e9-c643-4e15-8033-4511ff810e10
57992026-03-03T18:57:08.095ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
58002026-03-03T18:57:08.095ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:51160 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = fc5ba2e9-c643-4e15-8033-4511ff810e10
58012026-03-03T18:57:08.103ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
58022026-03-03T18:57:08.104ZTRACtest_metrics (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 4d d0 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c M............_cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:31638 req_id = b5c44a24-ac9d-4426-8f23-bfe227e71dc4
58032026-03-03T18:57:08.104ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 19920,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:31638 req_id = b5c44a24-ac9d-4426-8f23-bfe227e71dc4
58042026-03-03T18:57:08.104ZDEBGtest_metrics (store): query key key = _clickhouse-admin-keeper._tcp
58052026-03-03T18:57:08.105ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19920, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal kind = dns peer_addr = [::1]:31638 req_id = b5c44a24-ac9d-4426-8f23-bfe227e71dc4
58062026-03-03T18:57:08.105ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal
58072026-03-03T18:57:08.105ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 69.664502ms iteration = 6 status = {"Loaded":{"collection_id":"d1dc7331-a864-454e-8158-4de36b53c8fd","time_loaded":"2026-03-03T18:57:08.035535493Z","time_started":"2026-03-03T18:57:07.763643Z"}}
58082026-03-03T18:57:08.105ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
58092026-03-03T18:57:08.105ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
58102026-03-03T18:57:08.105ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58112026-03-03T18:57:08.105ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58122026-03-03T18:57:08.105ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58132026-03-03T18:57:08.105ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58142026-03-03T18:57:08.106ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 6 reason = Dependency
58152026-03-03T18:57:08.106ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
58162026-03-03T18:57:08.106ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
58172026-03-03T18:57:08.106ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
58182026-03-03T18:57:08.106ZDEBGtest_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Dependency
58192026-03-03T18:57:08.106ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 12.13\u{b5}s iteration = 6 status = {"error":"task disabled"}
58202026-03-03T18:57:08.106ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 8 reason = Dependency
58212026-03-03T18:57:08.106ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
58222026-03-03T18:57:08.106ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 12.64\u{b5}s iteration = 8 status = "Disabled"
58232026-03-03T18:57:08.106ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
58242026-03-03T18:57:08.109ZTRACtest_metrics (dns): buffer buffer = Length: 73 (0x49) bytes\n0000: 8c 52 01 00 00 01 00 00 00 00 00 01 0a 5f 63 6f .R..........._co\n0010: 63 6b 72 6f 61 63 68 04 5f 74 63 70 0d 63 6f 6e ckroach._tcp.con\n0020: 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 trol-plane.oxide\n0030: 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 .internal..!....\n0040: 29 04 d0 00 00 00 00 00 00 )........ kind = dns peer_addr = [::1]:54923 req_id = e580bc53-5dce-4060-899e-9251ff1debc4
58252026-03-03T18:57:08.109ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 35922,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_cockroach._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_cockroach._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:54923 req_id = e580bc53-5dce-4060-899e-9251ff1debc4
58262026-03-03T18:57:08.109ZDEBGtest_metrics (store): query key key = _cockroach._tcp
58272026-03-03T18:57:08.109ZDEBGtest_metrics (store): query key key = 8b178ee8-bb89-4436-88d8-e2f462915df4.host
58282026-03-03T18:57:08.109ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:54923 query = LowerQuery { name: LowerName(Name("_cockroach._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43291, target: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal") }) }] req_id = e580bc53-5dce-4060-899e-9251ff1debc4
58292026-03-03T18:57:08.109ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 64 38 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 d8..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:14614 req_id = 07c8b724-565e-478e-9e5b-749e8dc05b50
58302026-03-03T18:57:08.109ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 25656,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:14614 req_id = 07c8b724-565e-478e-9e5b-749e8dc05b50
58312026-03-03T18:57:08.109ZDEBGtest_metrics (store): query key key = _dendrite._tcp
58322026-03-03T18:57:08.109ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
58332026-03-03T18:57:08.109ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:14614 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 07c8b724-565e-478e-9e5b-749e8dc05b50
58342026-03-03T18:57:08.110ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58352026-03-03T18:57:08.112ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
58362026-03-03T18:57:08.112ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
58372026-03-03T18:57:08.113ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58382026-03-03T18:57:08.113ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58392026-03-03T18:57:08.113ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58402026-03-03T18:57:08.114ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58412026-03-03T18:57:08.115ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43291, target: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1965, tv_nsec: 378658847 } })
58422026-03-03T18:57:08.115ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
58432026-03-03T18:57:08.115ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1965, tv_nsec: 378852067 } })
58442026-03-03T18:57:08.115ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
58452026-03-03T18:57:08.115ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: a9 07 01 00 00 01 00 00 00 00 00 01 24 38 62 31 ............$8b1\n0010: 37 38 65 65 38 2d 62 62 38 39 2d 34 34 33 36 2d 78ee8-bb89-4436-\n0020: 38 38 64 38 2d 65 32 66 34 36 32 39 31 35 64 66 88d8-e2f462915df\n0030: 34 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 4.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:6201 req_id = 6fa6282d-f40b-46d7-837c-4e01926ef98f
58462026-03-03T18:57:08.115ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 43271,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 56,\n 98,\n 49,\n 55,\n 56,\n 101,\n 101,\n 56,\n 45,\n 98,\n 98,\n 56,\n 57,\n 45,\n 52,\n 52,\n 51,\n 54,\n 45,\n 56,\n 56,\n 100,\n 56,\n 45,\n 101,\n 50,\n 102,\n 52,\n 54,\n 50,\n 57,\n 49,\n 53,\n 100,\n 102,\n 52,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:6201 req_id = 6fa6282d-f40b-46d7-837c-4e01926ef98f
58472026-03-03T18:57:08.115ZDEBGtest_metrics (store): query key key = 8b178ee8-bb89-4436-88d8-e2f462915df4.host
58482026-03-03T18:57:08.115ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:6201 query = LowerQuery { name: LowerName(Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal.")), original: Query { name: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("8b178ee8-bb89-4436-88d8-e2f462915df4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 6fa6282d-f40b-46d7-837c-4e01926ef98f
58492026-03-03T18:57:08.115ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 95 4f 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .O..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:4141 req_id = 1bbbdef6-0f06-4878-89be-69ec20e2e940
58502026-03-03T18:57:08.115ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 38223,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:4141 req_id = 1bbbdef6-0f06-4878-89be-69ec20e2e940
58512026-03-03T18:57:08.115ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
58522026-03-03T18:57:08.115ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:4141 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 1bbbdef6-0f06-4878-89be-69ec20e2e940
58532026-03-03T18:57:08.115ZDEBGtest_metrics (BackgroundTasks): begin collection background_task = inventory_collection
58542026-03-03T18:57:08.115ZDEBGtest_metrics (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:42517
58552026-03-03T18:57:08.115ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/ignition
58562026-03-03T18:57:08.133ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:34679/switch/identifiers
58572026-03-03T18:57:08.133ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58582026-03-03T18:57:08.136ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
58592026-03-03T18:57:08.136ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58602026-03-03T18:57:08.136ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58612026-03-03T18:57:08.136ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58622026-03-03T18:57:08.138ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:34679/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "d01e7938-1647-4b3b-a548-3cbafb546bff", "content-length": "206", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
58632026-03-03T18:57:08.139ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
58642026-03-03T18:57:08.139ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
58652026-03-03T18:57:08.139ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
58662026-03-03T18:57:08.139ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
58672026-03-03T18:57:08.139ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
58682026-03-03T18:57:08.140ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58692026-03-03T18:57:08.140ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58702026-03-03T18:57:08.140ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58712026-03-03T18:57:08.140ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58722026-03-03T18:57:08.140ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "f81e959e-d9b7-4633-be83-e17be37f11d1", "content-length": "835", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
58732026-03-03T18:57:08.140ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0
58742026-03-03T18:57:08.141ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58752026-03-03T18:57:08.143ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
58762026-03-03T18:57:08.143ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
58772026-03-03T18:57:08.144ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58782026-03-03T18:57:08.144ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58792026-03-03T18:57:08.144ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58802026-03-03T18:57:08.144ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58812026-03-03T18:57:08.145ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
58822026-03-03T18:57:08.146ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
58832026-03-03T18:57:08.146ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
58842026-03-03T18:57:08.146ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
58852026-03-03T18:57:08.146ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
58862026-03-03T18:57:08.146ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58872026-03-03T18:57:08.149ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
58882026-03-03T18:57:08.149ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58892026-03-03T18:57:08.150ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58902026-03-03T18:57:08.151ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58912026-03-03T18:57:08.153ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
58922026-03-03T18:57:08.153ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
58932026-03-03T18:57:08.153ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
58942026-03-03T18:57:08.153ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
58952026-03-03T18:57:08.154ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
58962026-03-03T18:57:08.155ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "150c5014-04fa-476a-9455-9428007d5662", "content-length": "734", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
58972026-03-03T18:57:08.155ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=0
58982026-03-03T18:57:08.155ZINFOtest_metrics (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous num_already_exist = 0 num_inserted = 0 num_not_in_inventory = 0
58992026-03-03T18:57:08.155ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
59002026-03-03T18:57:08.155ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
59012026-03-03T18:57:08.155ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
59022026-03-03T18:57:08.155ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59032026-03-03T18:57:08.156ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59042026-03-03T18:57:08.156ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
59052026-03-03T18:57:08.156ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
59062026-03-03T18:57:08.156ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
59072026-03-03T18:57:08.156ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
59082026-03-03T18:57:08.163ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
59092026-03-03T18:57:08.165ZINFOtest_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
59102026-03-03T18:57:08.165ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
59112026-03-03T18:57:08.165ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
59122026-03-03T18:57:08.165ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
59132026-03-03T18:57:08.165ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
59142026-03-03T18:57:08.166ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
59152026-03-03T18:57:08.166ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59162026-03-03T18:57:08.169ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
59172026-03-03T18:57:08.171ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
59182026-03-03T18:57:08.171ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
59192026-03-03T18:57:08.171ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
59202026-03-03T18:57:08.171ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59212026-03-03T18:57:08.171ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59222026-03-03T18:57:08.171ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = b60ebbba-3b2d-4547-b34e-d77904b787a3 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
59232026-03-03T18:57:08.171ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = b60ebbba-3b2d-4547-b34e-d77904b787a3 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
59242026-03-03T18:57:08.171ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = b60ebbba-3b2d-4547-b34e-d77904b787a3 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
59252026-03-03T18:57:08.171ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = b60ebbba-3b2d-4547-b34e-d77904b787a3 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
59262026-03-03T18:57:08.171ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = b60ebbba-3b2d-4547-b34e-d77904b787a3 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
59272026-03-03T18:57:08.171ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
59282026-03-03T18:57:08.171ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
59292026-03-03T18:57:08.171ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
59302026-03-03T18:57:08.171ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
59312026-03-03T18:57:08.172ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
59322026-03-03T18:57:08.172ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59332026-03-03T18:57:08.175ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
59342026-03-03T18:57:08.175ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
59352026-03-03T18:57:08.175ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59362026-03-03T18:57:08.175ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59372026-03-03T18:57:08.177ZINFOtest_metrics (dropshot_internal): request completed latency_us = 5765 local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = b60ebbba-3b2d-4547-b34e-d77904b787a3 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
59382026-03-03T18:57:08.177ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b60ebbba-3b2d-4547-b34e-d77904b787a3", "content-length": "405", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
59392026-03-03T18:57:08.177ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
59402026-03-03T18:57:08.177ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
59412026-03-03T18:57:08.177ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
59422026-03-03T18:57:08.178ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
59432026-03-03T18:57:08.178ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 72.328125ms iteration = 6 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
59442026-03-03T18:57:08.178ZINFOtest_metrics (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
59452026-03-03T18:57:08.179ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
59462026-03-03T18:57:08.179ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
59472026-03-03T18:57:08.179ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
59482026-03-03T18:57:08.180ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59492026-03-03T18:57:08.180ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59502026-03-03T18:57:08.180ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 34907c2a-92e3-491b-adf7-d944d4756457 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
59512026-03-03T18:57:08.180ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 34907c2a-92e3-491b-adf7-d944d4756457 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D version = 1.0.0
59522026-03-03T18:57:08.180ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 34907c2a-92e3-491b-adf7-d944d4756457 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
59532026-03-03T18:57:08.180ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 34907c2a-92e3-491b-adf7-d944d4756457 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
59542026-03-03T18:57:08.181ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 34907c2a-92e3-491b-adf7-d944d4756457 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
59552026-03-03T18:57:08.181ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59562026-03-03T18:57:08.184ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
59572026-03-03T18:57:08.184ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
59582026-03-03T18:57:08.184ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
59592026-03-03T18:57:08.184ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
59602026-03-03T18:57:08.184ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59612026-03-03T18:57:08.184ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59622026-03-03T18:57:08.185ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "82bac2b6-428e-43de-9823-1c73f31e3f2b", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
59632026-03-03T18:57:08.187ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=1
59642026-03-03T18:57:08.187ZINFOtest_metrics (dropshot_internal): request completed latency_us = 6253 local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 34907c2a-92e3-491b-adf7-d944d4756457 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
59652026-03-03T18:57:08.187ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59662026-03-03T18:57:08.189ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
59672026-03-03T18:57:08.191ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
59682026-03-03T18:57:08.191ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59692026-03-03T18:57:08.191ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59702026-03-03T18:57:08.191ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "34907c2a-92e3-491b-adf7-d944d4756457", "content-length": "29", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
59712026-03-03T18:57:08.191ZDEBGtest_metrics (oximeter-agent): registered new metric producer address = 127.0.0.1:41769 collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4
59722026-03-03T18:57:08.191ZDEBGtest_metrics (oximeter-agent): registered new metric producer address = [::1]:42789 collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
59732026-03-03T18:57:08.191ZINFOtest_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
59742026-03-03T18:57:08.201ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
59752026-03-03T18:57:08.209ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
59762026-03-03T18:57:08.210ZDEBGtest_metrics (collection-task): reporting oximeter self-collection statistics collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
59772026-03-03T18:57:08.210ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
59782026-03-03T18:57:08.210ZDEBGtest_metrics (collection-task): reporting oximeter self-collection statistics collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
59792026-03-03T18:57:08.210ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
59802026-03-03T18:57:08.211ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
59812026-03-03T18:57:08.211ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
59822026-03-03T18:57:08.211ZINFOtest_metrics (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
59832026-03-03T18:57:08.211ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 106.31668ms iteration = 6 status = {"blueprint_id":"a34df21f-b47e-418a-ab97-8a520be16a04","inventory_collection_id":"d1dc7331-a864-454e-8158-4de36b53c8fd","stats":{"crucible_dataset":{"num_already_exist":0,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
59842026-03-03T18:57:08.211ZINFOtest_metrics (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = 127.0.0.1:41769 remote_addr = 127.0.0.1:53338
59852026-03-03T18:57:08.212ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 55b280ed-a387-4d9f-bc85-86f277bdab64 uri = /913233fe-92a8-4635-9572-183f495429c4
59862026-03-03T18:57:08.216ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 3843 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 55b280ed-a387-4d9f-bc85-86f277bdab64 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
59872026-03-03T18:57:08.216ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
59882026-03-03T18:57:08.216ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
59892026-03-03T18:57:08.217ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
59902026-03-03T18:57:08.217ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
59912026-03-03T18:57:08.217ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
59922026-03-03T18:57:08.224ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
59932026-03-03T18:57:08.224ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
59942026-03-03T18:57:08.224ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
59952026-03-03T18:57:08.224ZDEBGtest_metrics (results-sink): inserting 24 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
59962026-03-03T18:57:08.224ZDEBGtest_metrics (results-sink-cluster): inserting 24 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
59972026-03-03T18:57:08.224ZDEBGtest_metrics (clickhouse-client): unrolling 24 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
59982026-03-03T18:57:08.224ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
59992026-03-03T18:57:08.224ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = SELECT * FROM oximeter.timeseries_schema FORMAT Native;
60002026-03-03T18:57:08.225ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7c16e04-3837-4faa-80f1-c8e46da1b2a4", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60012026-03-03T18:57:08.226ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=0
60022026-03-03T18:57:08.226ZTRACtest_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
60032026-03-03T18:57:08.226ZDEBGtest_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T18:57:08.224907896Z } timeseries_name = oximeter_collector:collections
60042026-03-03T18:57:08.227ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
60052026-03-03T18:57:08.227ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('oximeter_collector:collections') FORMAT Native;
60062026-03-03T18:57:08.228ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa2b39e1-c88a-47dd-89f6-f28d3507232e", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60072026-03-03T18:57:08.228ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=1
60082026-03-03T18:57:08.228ZTRACtest_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
60092026-03-03T18:57:08.228ZDEBGtest_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af schema = TimeseriesSchema { timeseries_name: TimeseriesName("integration_target:integration_metric"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "metric_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "target_name", field_type: String, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T18:57:08.227235790Z } timeseries_name = integration_target:integration_metric
60102026-03-03T18:57:08.229ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
60112026-03-03T18:57:08.229ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('integration_target:integration_metric', 'oximeter_collector:collections') FORMAT Native;
60122026-03-03T18:57:08.229ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "631583cb-2f92-49db-978a-7b0719bb3c95", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60132026-03-03T18:57:08.233ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=0
60142026-03-03T18:57:08.233ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a59b59e-3fd2-4b12-b85c-c0ab54f3dd0a", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60152026-03-03T18:57:08.233ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=1
60162026-03-03T18:57:08.233ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "067b5cd4-8ef2-46f2-8077-5bcb8c557c5e", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60172026-03-03T18:57:08.233ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cmpa
60182026-03-03T18:57:08.233ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "54ba78d6-778e-44a4-aaee-192c0d4502b1", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60192026-03-03T18:57:08.233ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
60202026-03-03T18:57:08.233ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e997c32-8910-4b00-aa0f-cd36367782bc", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60212026-03-03T18:57:08.233ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
60222026-03-03T18:57:08.233ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "410bd320-73e7-4d60-a6b9-c4d62dffad18", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60232026-03-03T18:57:08.233ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/0/component/rot/cfpa
60242026-03-03T18:57:08.233ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a0dda2f-d88b-4d80-9296-4c73d6c1a7c8", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60252026-03-03T18:57:08.233ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1
60262026-03-03T18:57:08.233ZTRACtest_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
60272026-03-03T18:57:08.233ZDEBGtest_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T18:57:08.229052973Z } timeseries_name = http_service:request_latency_histogram
60282026-03-03T18:57:08.236ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
60292026-03-03T18:57:08.236ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('http_service:request_latency_histogram', 'integration_target:integration_metric', 'oximeter_collector:collections') FORMAT Native;
60302026-03-03T18:57:08.237ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c74ea9c8-f1ec-43b7-b1e1-86b530b53100", "content-length": "734", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60312026-03-03T18:57:08.238ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=0
60322026-03-03T18:57:08.238ZTRACtest_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
60332026-03-03T18:57:08.238ZDEBGtest_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T18:57:08.236934045Z } timeseries_name = collection_target:cpus_provisioned
60342026-03-03T18:57:08.238ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
60352026-03-03T18:57:08.238ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('collection_target:cpus_provisioned', 'http_service:request_latency_histogram', 'integration_target:integration_metric', 'oximeter_collector:collections') FORMAT Native;
60362026-03-03T18:57:08.239ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "db50850e-80c9-4c56-863f-bbdd4b708216", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60372026-03-03T18:57:08.239ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=1
60382026-03-03T18:57:08.239ZTRACtest_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
60392026-03-03T18:57:08.240ZDEBGtest_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T18:57:08.238788748Z } timeseries_name = collection_target:ram_provisioned
60402026-03-03T18:57:08.240ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
60412026-03-03T18:57:08.240ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('collection_target:cpus_provisioned', 'collection_target:ram_provisioned', 'http_service:request_latency_histogram', 'integration_target:integration_metric', 'oximeter_collector:collections') FORMAT Native;
60422026-03-03T18:57:08.241ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "584e5c34-841c-4edd-a816-f97c045f47da", "content-length": "111", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60432026-03-03T18:57:08.241ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=0
60442026-03-03T18:57:08.241ZTRACtest_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
60452026-03-03T18:57:08.241ZDEBGtest_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T18:57:08.240362061Z } timeseries_name = collection_target:virtual_disk_space_provisioned
60462026-03-03T18:57:08.244ZDEBGtest_metrics (clickhouse-client): inserting 6 new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
60472026-03-03T18:57:08.244ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 6 n_rows = 6 sql = INSERT INTO oximeter.timeseries_schema FORMAT Native
60482026-03-03T18:57:08.245ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5a4df36-30bb-4153-98f5-e7f381a14aba", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60492026-03-03T18:57:08.245ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=1
60502026-03-03T18:57:08.246ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 4 sql = INSERT INTO oximeter.fields_ipaddr FORMAT Native
60512026-03-03T18:57:08.246ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "84de1505-a5c6-4316-bc14-471ac192db88", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60522026-03-03T18:57:08.246ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=0
60532026-03-03T18:57:08.247ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 4 table_name = fields_ipaddr
60542026-03-03T18:57:08.247ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_string FORMAT Native
60552026-03-03T18:57:08.247ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5e8641d-b4af-4d1f-a553-3f2c36740513", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60562026-03-03T18:57:08.247ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=1
60572026-03-03T18:57:08.248ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5569e8dd-b0fa-4e66-b449-3ff1b24bd91b", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60582026-03-03T18:57:08.248ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cmpa
60592026-03-03T18:57:08.248ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 22 table_name = fields_string
60602026-03-03T18:57:08.248ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 13 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
60612026-03-03T18:57:08.249ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e297b7c5-daf8-4a1c-a799-a826d248bfb1", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60622026-03-03T18:57:08.249ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
60632026-03-03T18:57:08.250ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 13 table_name = fields_u16
60642026-03-03T18:57:08.250ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 25 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
60652026-03-03T18:57:08.250ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e2ee707-4ada-4216-9e84-a231f184568f", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60662026-03-03T18:57:08.250ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
60672026-03-03T18:57:08.250ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "21c46b84-68f4-427d-a5ec-478b5b307908", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60682026-03-03T18:57:08.250ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/switch/1/component/rot/cfpa
60692026-03-03T18:57:08.251ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 25 table_name = fields_uuid
60702026-03-03T18:57:08.251ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 5 n_rows = 2 sql = INSERT INTO oximeter.measurements_cumulativeu64 FORMAT Native
60712026-03-03T18:57:08.251ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2715dd3d-abee-40f4-901c-d4f2357e3b9d", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60722026-03-03T18:57:08.251ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0
60732026-03-03T18:57:08.252ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = measurements_cumulativeu64
60742026-03-03T18:57:08.252ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 9 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
60752026-03-03T18:57:08.252ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e730d97a-87a6-437a-9890-d01aa27afc83", "content-length": "723", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60762026-03-03T18:57:08.252ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/active-slot
60772026-03-03T18:57:08.253ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa9a234a-4102-4e91-921a-bbe24e259099", "content-length": "10", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60782026-03-03T18:57:08.253ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/0
60792026-03-03T18:57:08.253ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 9 table_name = measurements_histogramu64
60802026-03-03T18:57:08.253ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 13 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
60812026-03-03T18:57:08.254ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "328d2374-0fea-4e22-bbfd-66217479b010", "content-length": "144", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60822026-03-03T18:57:08.254ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/1
60832026-03-03T18:57:08.254ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "76f08f87-6a62-4069-98c6-92aed2714037", "content-length": "147", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60842026-03-03T18:57:08.254ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=0
60852026-03-03T18:57:08.255ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 13 table_name = measurements_i64
60862026-03-03T18:57:08.255ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
60872026-03-03T18:57:08.255ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a3d8b31-50cb-4403-8c53-b2a1f5d25192", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60882026-03-03T18:57:08.255ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=1
60892026-03-03T18:57:08.256ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "79a19f4c-4a5f-470b-b088-cb6f09edcd14", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60902026-03-03T18:57:08.256ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=0
60912026-03-03T18:57:08.257ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "48cbb8ba-240e-40d7-9d97-b1fb397b59a5", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60922026-03-03T18:57:08.257ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=1
60932026-03-03T18:57:08.258ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab2c73f3-60be-4039-a68a-e77f3c46d4b2", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60942026-03-03T18:57:08.258ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=0
60952026-03-03T18:57:08.258ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f493be74-0452-4d58-a37d-c04747810841", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60962026-03-03T18:57:08.258ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=1
60972026-03-03T18:57:08.259ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f86fc38-a667-4850-bbfc-35662b0d3c5e", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
60982026-03-03T18:57:08.260ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cmpa
60992026-03-03T18:57:08.260ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff4c3e11-e7dc-4b75-a83b-c26de95dcba0", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61002026-03-03T18:57:08.260ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
61012026-03-03T18:57:08.260ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1b15793-1c4c-47b3-a2a1-f60b06a3ecbf", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61022026-03-03T18:57:08.260ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
61032026-03-03T18:57:08.261ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "71fb00e9-2050-4304-a450-e098b01ff988", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61042026-03-03T18:57:08.261ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/0/component/rot/cfpa
61052026-03-03T18:57:08.261ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3f8c606-02b0-4cd8-8786-bddc709b83c6", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61062026-03-03T18:57:08.261ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1
61072026-03-03T18:57:08.262ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ecfff02-9aaa-41b3-bc9a-888e058610a3", "content-length": "723", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61082026-03-03T18:57:08.262ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/active-slot
61092026-03-03T18:57:08.263ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c7b7254-0518-49b0-924e-50b2ad67d9b1", "content-length": "10", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61102026-03-03T18:57:08.263ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/0
61112026-03-03T18:57:08.265ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2873c87-dc72-44d0-80f7-830785aa3a04", "content-length": "144", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61122026-03-03T18:57:08.265ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/1
61132026-03-03T18:57:08.265ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf4032af-40c0-4d08-a461-141feba3c64a", "content-length": "147", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61142026-03-03T18:57:08.265ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=0
61152026-03-03T18:57:08.265ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3a2772b-9113-4834-997b-7af75c9b0ecc", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61162026-03-03T18:57:08.265ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=1
61172026-03-03T18:57:08.265ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a4f5422-5e9c-4f8a-bae3-5c235898b1f7", "content-length": "109", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61182026-03-03T18:57:08.265ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=0
61192026-03-03T18:57:08.266ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfe578dd-3149-4d33-8198-908fa5dbafd7", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61202026-03-03T18:57:08.266ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=1
61212026-03-03T18:57:08.268ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "58aa4ff8-4657-4e5d-ba80-f7ce2e178d7c", "content-length": "163", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61222026-03-03T18:57:08.268ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=0
61232026-03-03T18:57:08.268ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2254c191-7c0f-449d-9f04-3ae981a07178", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61242026-03-03T18:57:08.268ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=1
61252026-03-03T18:57:08.268ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d0ead7e-a0a1-494c-a9f7-757e4114c3ee", "content-length": "166", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61262026-03-03T18:57:08.268ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cmpa
61272026-03-03T18:57:08.268ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d144299-b5bf-4bdb-b489-bdc7dc71dfcc", "content-length": "702", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61282026-03-03T18:57:08.268ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
61292026-03-03T18:57:08.269ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d838b667-04f4-4c7e-93e7-64aac2145722", "content-length": "727", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61302026-03-03T18:57:08.269ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
61312026-03-03T18:57:08.273ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "48194e4a-6fea-4389-a1af-0a7cd9d09370", "content-length": "729", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61322026-03-03T18:57:08.273ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:42517 method = GET uri = http://[::1]:42517/sp/sled/1/component/rot/cfpa
61332026-03-03T18:57:08.273ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:42517 result = Ok(Response { url: "http://[::1]:42517/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e20e723c-b92a-47bd-a873-763e849db284", "content-length": "728", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61342026-03-03T18:57:08.273ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
61352026-03-03T18:57:08.273ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
61362026-03-03T18:57:08.273ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
61372026-03-03T18:57:08.273ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
61382026-03-03T18:57:08.273ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
61392026-03-03T18:57:08.278ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61402026-03-03T18:57:08.282ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
61412026-03-03T18:57:08.282ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
61422026-03-03T18:57:08.282ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
61432026-03-03T18:57:08.282ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
61442026-03-03T18:57:08.282ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
61452026-03-03T18:57:08.282ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
61462026-03-03T18:57:08.284ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61472026-03-03T18:57:08.287ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
61482026-03-03T18:57:08.287ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
61492026-03-03T18:57:08.287ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
61502026-03-03T18:57:08.287ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
61512026-03-03T18:57:08.299ZDEBGtest_metrics (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:36085
61522026-03-03T18:57:08.299ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = http://[::1]:36085 background_task = inventory_collection body = None method = GET uri = http://[::1]:36085/inventory
61532026-03-03T18:57:08.299ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35818 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
61542026-03-03T18:57:08.300ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = GET remote_addr = [::1]:35818 req_id = f74bf73e-06cf-44db-aa2b-cd15e0c4efdf sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
61552026-03-03T18:57:08.300ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = GET remote_addr = [::1]:35818 req_id = f74bf73e-06cf-44db-aa2b-cd15e0c4efdf sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory version = 23.0.0
61562026-03-03T18:57:08.301ZINFOtest_metrics (dropshot): request completed latency_us = 1171 local_addr = [::1]:36085 method = GET remote_addr = [::1]:35818 req_id = f74bf73e-06cf-44db-aa2b-cd15e0c4efdf response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
61572026-03-03T18:57:08.301ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = http://[::1]:36085 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:36085/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "f74bf73e-06cf-44db-aa2b-cd15e0c4efdf", "content-length": "19983", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61582026-03-03T18:57:08.302ZDEBGtest_metrics (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
61592026-03-03T18:57:08.302ZDEBGtest_metrics (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
61602026-03-03T18:57:08.302ZDEBGtest_metrics (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
61612026-03-03T18:57:08.302ZDEBGtest_metrics (CockroachClusterAdminClient): client request body = None method = GET uri = http://[::1]:32222/node/id
61622026-03-03T18:57:08.303ZDEBGtest_metrics (CockroachClusterAdminClient): client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
61632026-03-03T18:57:08.303ZWARNtest_metrics (CockroachClusterAdminClient): Failed to fetch metrics from CockroachDB node error = Failed to get node ID from [::1]:32222
61642026-03-03T18:57:08.312ZDEBGtest_metrics (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[::1]:10123 zone_id = 128cd5ee-2d78-44f6-9fb4-83dda8b3d1a4 (omicron_zone)
61652026-03-03T18:57:08.312ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[::1]:10123 uri = http://[::1]:10123/timesync
61662026-03-03T18:57:08.312ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[::1]:10123 result = Err(reqwest::Error { kind: Request, url: "http://[::1]:10123/timesync", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:10123, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
61672026-03-03T18:57:08.317ZDEBGtest_metrics (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
61682026-03-03T18:57:08.322ZDEBGtest_metrics (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 2a83ee47-a98f-4924-a414-6bdba496b84f (omicron_zone)
61692026-03-03T18:57:08.322ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[::1]:34487 method = GET uri = http://[::1]:34487/config
61702026-03-03T18:57:08.322ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:34487 remote_addr = [::1]:39250
61712026-03-03T18:57:08.323ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:34487 method = GET remote_addr = [::1]:39250 req_id = 316f235b-240b-4e81-ab3f-6060e6f6c3a6 uri = /config
61722026-03-03T18:57:08.323ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:34487 method = GET remote_addr = [::1]:39250 req_id = 316f235b-240b-4e81-ab3f-6060e6f6c3a6 uri = /config version = 2.0.0
61732026-03-03T18:57:08.323ZINFOtest_metrics (http): request completed kind = dns latency_us = 563 local_addr = [::1]:34487 method = GET remote_addr = [::1]:39250 req_id = 316f235b-240b-4e81-ab3f-6060e6f6c3a6 response_code = 200 uri = /config
61742026-03-03T18:57:08.324ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[::1]:34487 result = Ok(Response { url: "http://[::1]:34487/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "316f235b-240b-4e81-ab3f-6060e6f6c3a6", "content-length": "3478", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
61752026-03-03T18:57:08.324ZDEBGtest_metrics (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 2a83ee47-a98f-4924-a414-6bdba496b84f (omicron_zone)
61762026-03-03T18:57:08.324ZDEBGtest_metrics (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
61772026-03-03T18:57:08.324ZDEBGtest_metrics (BackgroundTasks): finished collection background_task = inventory_collection
61782026-03-03T18:57:08.324ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
61792026-03-03T18:57:08.324ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
61802026-03-03T18:57:08.324ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
61812026-03-03T18:57:08.324ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
61822026-03-03T18:57:08.325ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
61832026-03-03T18:57:08.326ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
61842026-03-03T18:57:08.327ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61852026-03-03T18:57:08.337ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
61862026-03-03T18:57:08.337ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
61872026-03-03T18:57:08.337ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
61882026-03-03T18:57:08.337ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
61892026-03-03T18:57:08.424ZINFOtest_metrics (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 0af0471d-c5b8-438d-8ba0-a6627278fdc0
61902026-03-03T18:57:08.424ZDEBGtest_metrics (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 0af0471d-c5b8-438d-8ba0-a6627278fdc0 time_started = 2026-03-03 18:57:08.114828 UTC
61912026-03-03T18:57:08.424ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 390.311725ms iteration = 7 status = {"collection_id":"0af0471d-c5b8-438d-8ba0-a6627278fdc0","time_done":"2026-03-03 18:57:08.324424 UTC","time_started":"2026-03-03 18:57:08.114828 UTC"}
61922026-03-03T18:57:08.424ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 7 reason = Dependency
61932026-03-03T18:57:08.424ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
61942026-03-03T18:57:08.424ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
61952026-03-03T18:57:08.424ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
61962026-03-03T18:57:08.424ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
61972026-03-03T18:57:08.425ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
61982026-03-03T18:57:08.427ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61992026-03-03T18:57:08.431ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
62002026-03-03T18:57:08.431ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
62012026-03-03T18:57:08.431ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
62022026-03-03T18:57:08.431ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
62032026-03-03T18:57:08.433ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
62042026-03-03T18:57:08.433ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
62052026-03-03T18:57:08.434ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
62062026-03-03T18:57:08.461ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 36.984599ms iteration = 7 status = {"Loaded":{"collection_id":"0af0471d-c5b8-438d-8ba0-a6627278fdc0","time_loaded":"2026-03-03T18:57:08.424739586Z","time_started":"2026-03-03T18:57:08.114828Z"}}
62072026-03-03T18:57:08.461ZDEBGtest_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Dependency
62082026-03-03T18:57:08.461ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 24.52\u{b5}s iteration = 7 status = {"error":"task disabled"}
62092026-03-03T18:57:08.461ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 9 reason = Dependency
62102026-03-03T18:57:08.461ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
62112026-03-03T18:57:08.461ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 15.75\u{b5}s iteration = 9 status = "Disabled"
62122026-03-03T18:57:08.461ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 7 reason = Dependency
62132026-03-03T18:57:08.461ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
62142026-03-03T18:57:08.461ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
62152026-03-03T18:57:08.461ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
62162026-03-03T18:57:08.462ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 7 reason = Dependency
62172026-03-03T18:57:08.462ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
62182026-03-03T18:57:08.462ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
62192026-03-03T18:57:08.462ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
62202026-03-03T18:57:08.462ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62212026-03-03T18:57:08.462ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62222026-03-03T18:57:08.463ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: f7 57 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .W..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:58716 req_id = 8e064cc2-83b2-4eae-9f8f-6ef4977d7dc2
62232026-03-03T18:57:08.463ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 63319,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:58716 req_id = 8e064cc2-83b2-4eae-9f8f-6ef4977d7dc2
62242026-03-03T18:57:08.463ZDEBGtest_metrics (store): query key key = _dendrite._tcp
62252026-03-03T18:57:08.464ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
62262026-03-03T18:57:08.464ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:58716 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 8e064cc2-83b2-4eae-9f8f-6ef4977d7dc2
62272026-03-03T18:57:08.464ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1965, tv_nsec: 729000658 } })
62282026-03-03T18:57:08.464ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
62292026-03-03T18:57:08.464ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 4d d1 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e M...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:51310 req_id = 28f35d6a-2ba1-41f6-9cc9-ba4809477398
62302026-03-03T18:57:08.464ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 19921,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:51310 req_id = 28f35d6a-2ba1-41f6-9cc9-ba4809477398
62312026-03-03T18:57:08.464ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
62322026-03-03T18:57:08.464ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:51310 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 28f35d6a-2ba1-41f6-9cc9-ba4809477398
62332026-03-03T18:57:08.464ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62342026-03-03T18:57:08.467ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
62352026-03-03T18:57:08.467ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
62362026-03-03T18:57:08.467ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
62372026-03-03T18:57:08.467ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
62382026-03-03T18:57:08.468ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62392026-03-03T18:57:08.468ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62402026-03-03T18:57:08.487ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:34679/switch/identifiers
62412026-03-03T18:57:08.488ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62422026-03-03T18:57:08.491ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
62432026-03-03T18:57:08.491ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
62442026-03-03T18:57:08.491ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62452026-03-03T18:57:08.491ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62462026-03-03T18:57:08.492ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:34679/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "a217f5be-75a8-446d-9d8c-6d3cf7d4a8ea", "content-length": "206", "date": "Tue, 03 Mar 2026 18:57:08 GMT"} })
62472026-03-03T18:57:08.492ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
62482026-03-03T18:57:08.492ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
62492026-03-03T18:57:08.492ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
62502026-03-03T18:57:08.493ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
62512026-03-03T18:57:08.494ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
62522026-03-03T18:57:08.494ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
62532026-03-03T18:57:08.494ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
62542026-03-03T18:57:08.494ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62552026-03-03T18:57:08.494ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62562026-03-03T18:57:08.495ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
62572026-03-03T18:57:08.495ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
62582026-03-03T18:57:08.495ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
62592026-03-03T18:57:08.495ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
62602026-03-03T18:57:08.495ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
62612026-03-03T18:57:08.497ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62622026-03-03T18:57:08.500ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
62632026-03-03T18:57:08.500ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
62642026-03-03T18:57:08.500ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
62652026-03-03T18:57:08.500ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
62662026-03-03T18:57:08.500ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62672026-03-03T18:57:08.500ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62682026-03-03T18:57:08.501ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
62692026-03-03T18:57:08.501ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
62702026-03-03T18:57:08.501ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
62712026-03-03T18:57:08.501ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
62722026-03-03T18:57:08.501ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
62732026-03-03T18:57:08.503ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
62742026-03-03T18:57:08.503ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
62752026-03-03T18:57:08.503ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
62762026-03-03T18:57:08.503ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
62772026-03-03T18:57:08.503ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
62782026-03-03T18:57:08.504ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62792026-03-03T18:57:08.507ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
62802026-03-03T18:57:08.510ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
62812026-03-03T18:57:08.510ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62822026-03-03T18:57:08.510ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62832026-03-03T18:57:08.510ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
62842026-03-03T18:57:08.510ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
62852026-03-03T18:57:08.510ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
62862026-03-03T18:57:08.510ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
62872026-03-03T18:57:08.510ZINFOtest_metrics (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous num_already_exist = 0 num_inserted = 0 num_not_in_inventory = 0
62882026-03-03T18:57:08.510ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
62892026-03-03T18:57:08.510ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
62902026-03-03T18:57:08.510ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
62912026-03-03T18:57:08.510ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62922026-03-03T18:57:08.510ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62932026-03-03T18:57:08.512ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
62942026-03-03T18:57:08.512ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
62952026-03-03T18:57:08.512ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
62962026-03-03T18:57:08.512ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
62972026-03-03T18:57:08.512ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
62982026-03-03T18:57:08.513ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62992026-03-03T18:57:08.515ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
63002026-03-03T18:57:08.516ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
63012026-03-03T18:57:08.516ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
63022026-03-03T18:57:08.516ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
63032026-03-03T18:57:08.516ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63042026-03-03T18:57:08.516ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63052026-03-03T18:57:08.517ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
63062026-03-03T18:57:08.521ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
63072026-03-03T18:57:08.521ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
63082026-03-03T18:57:08.521ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 57.025472ms iteration = 7 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
63092026-03-03T18:57:08.521ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63102026-03-03T18:57:08.522ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
63112026-03-03T18:57:08.522ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
63122026-03-03T18:57:08.522ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63132026-03-03T18:57:08.522ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63142026-03-03T18:57:08.524ZINFOtest_metrics (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
63152026-03-03T18:57:08.525ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
63162026-03-03T18:57:08.525ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
63172026-03-03T18:57:08.525ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
63182026-03-03T18:57:08.525ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63192026-03-03T18:57:08.525ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63202026-03-03T18:57:08.526ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63212026-03-03T18:57:08.529ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
63222026-03-03T18:57:08.529ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
63232026-03-03T18:57:08.529ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
63242026-03-03T18:57:08.529ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
63252026-03-03T18:57:08.529ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63262026-03-03T18:57:08.529ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63272026-03-03T18:57:08.531ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63282026-03-03T18:57:08.534ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
63292026-03-03T18:57:08.536ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
63302026-03-03T18:57:08.536ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63312026-03-03T18:57:08.536ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63322026-03-03T18:57:08.536ZINFOtest_metrics (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
63332026-03-03T18:57:08.536ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 74.093029ms iteration = 7 status = {"blueprint_id":"a34df21f-b47e-418a-ab97-8a520be16a04","inventory_collection_id":"0af0471d-c5b8-438d-8ba0-a6627278fdc0","stats":{"crucible_dataset":{"num_already_exist":0,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
63342026-03-03T18:57:09.056ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
63352026-03-03T18:57:09.056ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
63362026-03-03T18:57:09.110ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
63372026-03-03T18:57:09.112ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
63382026-03-03T18:57:09.112ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
63392026-03-03T18:57:09.112ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
63402026-03-03T18:57:09.112ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
63412026-03-03T18:57:09.112ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
63422026-03-03T18:57:09.112ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
63432026-03-03T18:57:09.112ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
63442026-03-03T18:57:09.112ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1 version = 2026021900.0.0
63452026-03-03T18:57:09.112ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = da5f4cde-5a00-4be1-8e4c-4dc74845227a uri = /913233fe-92a8-4635-9572-183f495429c4
63462026-03-03T18:57:09.112ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
63472026-03-03T18:57:09.112ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
63482026-03-03T18:57:09.112ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63492026-03-03T18:57:09.112ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
63502026-03-03T18:57:09.112ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
63512026-03-03T18:57:09.117ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5525 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = da5f4cde-5a00-4be1-8e4c-4dc74845227a response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
63522026-03-03T18:57:09.122ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
63532026-03-03T18:57:09.128ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
63542026-03-03T18:57:09.130ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
63552026-03-03T18:57:09.132ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
63562026-03-03T18:57:09.133ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
63572026-03-03T18:57:09.133ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
63582026-03-03T18:57:09.133ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
63592026-03-03T18:57:09.133ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
63602026-03-03T18:57:09.134ZDEBGtest_metrics (results-sink): inserting 9 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
63612026-03-03T18:57:09.134ZDEBGtest_metrics (results-sink-cluster): inserting 9 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
63622026-03-03T18:57:09.134ZDEBGtest_metrics (clickhouse-client): unrolling 9 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
63632026-03-03T18:57:09.138ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 18 sql = INSERT INTO oximeter.fields_string FORMAT Native
63642026-03-03T18:57:09.142ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63652026-03-03T18:57:09.142ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
63662026-03-03T18:57:09.142ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
63672026-03-03T18:57:09.142ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 18 table_name = fields_string
63682026-03-03T18:57:09.142ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 9 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
63692026-03-03T18:57:09.142ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
63702026-03-03T18:57:09.142ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
63712026-03-03T18:57:09.142ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63722026-03-03T18:57:09.142ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
63732026-03-03T18:57:09.142ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
63742026-03-03T18:57:09.144ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 9 table_name = fields_u16
63752026-03-03T18:57:09.146ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 9 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
63762026-03-03T18:57:09.146ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
63772026-03-03T18:57:09.146ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63782026-03-03T18:57:09.146ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
63792026-03-03T18:57:09.146ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
63802026-03-03T18:57:09.153ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 9 table_name = fields_uuid
63812026-03-03T18:57:09.155ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 9 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
63822026-03-03T18:57:09.155ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
63832026-03-03T18:57:09.155ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
63842026-03-03T18:57:09.155ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63852026-03-03T18:57:09.155ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
63862026-03-03T18:57:09.155ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
63872026-03-03T18:57:09.161ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
63882026-03-03T18:57:09.161ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
63892026-03-03T18:57:09.161ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63902026-03-03T18:57:09.161ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
63912026-03-03T18:57:09.162ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
63922026-03-03T18:57:09.163ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 9 table_name = measurements_histogramu64
63932026-03-03T18:57:09.163ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
63942026-03-03T18:57:09.163ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
63952026-03-03T18:57:09.163ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
63962026-03-03T18:57:09.169ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
63972026-03-03T18:57:09.169ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
63982026-03-03T18:57:09.169ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63992026-03-03T18:57:09.169ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64002026-03-03T18:57:09.170ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64012026-03-03T18:57:09.170ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
64022026-03-03T18:57:09.170ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
64032026-03-03T18:57:09.170ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
64042026-03-03T18:57:09.171ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
64052026-03-03T18:57:09.171ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64062026-03-03T18:57:09.171ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64072026-03-03T18:57:09.171ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64082026-03-03T18:57:09.171ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64092026-03-03T18:57:09.171ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64102026-03-03T18:57:09.171ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64112026-03-03T18:57:09.174ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
64122026-03-03T18:57:09.174ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64132026-03-03T18:57:09.176ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64142026-03-03T18:57:09.178ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64152026-03-03T18:57:09.178ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64162026-03-03T18:57:09.178ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64172026-03-03T18:57:09.178ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64182026-03-03T18:57:09.178ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64192026-03-03T18:57:09.179ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64202026-03-03T18:57:09.181ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64212026-03-03T18:57:09.184ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64222026-03-03T18:57:09.185ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f
64232026-03-03T18:57:09.185ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.timeseries_schema FORMAT Native;
64242026-03-03T18:57:09.187ZTRACtest_metrics (clickhouse-client): retrieved new timeseries schema id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f n_schema = 6
64252026-03-03T18:57:09.191ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
64262026-03-03T18:57:09.217ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
64272026-03-03T18:57:09.217ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
64282026-03-03T18:57:09.217ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (12379067900625785140) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:09.110608714' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
64292026-03-03T18:57:09.219ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
64302026-03-03T18:57:09.219ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
64312026-03-03T18:57:09.219ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
64322026-03-03T18:57:09.219ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
64332026-03-03T18:57:09.220ZINFOtest_metrics (dropshot_external): request completed latency_us = 108933 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 5721d0c8-97f8-44dd-b5f7-3c32c5b0e56d response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.110608714Z&order=descending&limit=1
64342026-03-03T18:57:09.220ZINFOtest_metrics (external client test context): client received response status = 200
64352026-03-03T18:57:09.220ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
64362026-03-03T18:57:09.221ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
64372026-03-03T18:57:09.221ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
64382026-03-03T18:57:09.221ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
64392026-03-03T18:57:09.221ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
64402026-03-03T18:57:09.221ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
64412026-03-03T18:57:09.221ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
64422026-03-03T18:57:09.221ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
64432026-03-03T18:57:09.221ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1 version = 2026021900.0.0
64442026-03-03T18:57:09.221ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 4075087f-2a0a-4aa6-b74b-b8af443ca375 uri = /913233fe-92a8-4635-9572-183f495429c4
64452026-03-03T18:57:09.227ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
64462026-03-03T18:57:09.227ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
64472026-03-03T18:57:09.227ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64482026-03-03T18:57:09.227ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64492026-03-03T18:57:09.228ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64502026-03-03T18:57:09.233ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 11807 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 4075087f-2a0a-4aa6-b74b-b8af443ca375 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
64512026-03-03T18:57:09.234ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
64522026-03-03T18:57:09.234ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
64532026-03-03T18:57:09.234ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
64542026-03-03T18:57:09.234ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
64552026-03-03T18:57:09.234ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
64562026-03-03T18:57:09.239ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
64572026-03-03T18:57:09.239ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
64582026-03-03T18:57:09.239ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
64592026-03-03T18:57:09.239ZDEBGtest_metrics (results-sink): inserting 2 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64602026-03-03T18:57:09.239ZDEBGtest_metrics (clickhouse-client): unrolling 2 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
64612026-03-03T18:57:09.240ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
64622026-03-03T18:57:09.240ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
64632026-03-03T18:57:09.240ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64642026-03-03T18:57:09.241ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64652026-03-03T18:57:09.241ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64662026-03-03T18:57:09.242ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64672026-03-03T18:57:09.244ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
64682026-03-03T18:57:09.244ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
64692026-03-03T18:57:09.244ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64702026-03-03T18:57:09.244ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64712026-03-03T18:57:09.244ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64722026-03-03T18:57:09.246ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
64732026-03-03T18:57:09.246ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64742026-03-03T18:57:09.246ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64752026-03-03T18:57:09.246ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64762026-03-03T18:57:09.253ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
64772026-03-03T18:57:09.253ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
64782026-03-03T18:57:09.253ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64792026-03-03T18:57:09.253ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64802026-03-03T18:57:09.253ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64812026-03-03T18:57:09.253ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
64822026-03-03T18:57:09.253ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
64832026-03-03T18:57:09.253ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64842026-03-03T18:57:09.253ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64852026-03-03T18:57:09.253ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64862026-03-03T18:57:09.254ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
64872026-03-03T18:57:09.254ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64882026-03-03T18:57:09.254ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64892026-03-03T18:57:09.255ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64902026-03-03T18:57:09.256ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
64912026-03-03T18:57:09.258ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
64922026-03-03T18:57:09.258ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
64932026-03-03T18:57:09.258ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
64942026-03-03T18:57:09.258ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
64952026-03-03T18:57:09.258ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
64962026-03-03T18:57:09.258ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
64972026-03-03T18:57:09.259ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
64982026-03-03T18:57:09.261ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
64992026-03-03T18:57:09.263ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
65002026-03-03T18:57:09.264ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
65012026-03-03T18:57:09.264ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
65022026-03-03T18:57:09.264ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
65032026-03-03T18:57:09.264ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
65042026-03-03T18:57:09.265ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
65052026-03-03T18:57:09.265ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
65062026-03-03T18:57:09.265ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
65072026-03-03T18:57:09.266ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
65082026-03-03T18:57:09.269ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
65092026-03-03T18:57:09.271ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
65102026-03-03T18:57:09.272ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = measurements_i64
65112026-03-03T18:57:09.272ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65122026-03-03T18:57:09.272ZDEBGtest_metrics (results-sink): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65132026-03-03T18:57:09.272ZDEBGtest_metrics (clickhouse-client): unrolling 10 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
65142026-03-03T18:57:09.276ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 20 sql = INSERT INTO oximeter.fields_string FORMAT Native
65152026-03-03T18:57:09.276ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (7763646387282271213) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:09.220810191' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
65162026-03-03T18:57:09.281ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 20 table_name = fields_string
65172026-03-03T18:57:09.281ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
65182026-03-03T18:57:09.281ZINFOtest_metrics (dropshot_external): request completed latency_us = 60491 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6008e422-3080-4779-8540-6797bf5c6cb7 response_code = 200 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.220810191Z&order=descending&limit=1
65192026-03-03T18:57:09.282ZINFOtest_metrics (external client test context): client received response status = 200
65202026-03-03T18:57:09.282ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
65212026-03-03T18:57:09.282ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
65222026-03-03T18:57:09.282ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
65232026-03-03T18:57:09.282ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
65242026-03-03T18:57:09.282ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
65252026-03-03T18:57:09.282ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
65262026-03-03T18:57:09.282ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
65272026-03-03T18:57:09.283ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = fields_u16
65282026-03-03T18:57:09.283ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
65292026-03-03T18:57:09.283ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
65302026-03-03T18:57:09.283ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1 version = 2026021900.0.0
65312026-03-03T18:57:09.283ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = a9604ac4-3766-48eb-b9d6-76aa1dacbc40 uri = /913233fe-92a8-4635-9572-183f495429c4
65322026-03-03T18:57:09.283ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
65332026-03-03T18:57:09.283ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
65342026-03-03T18:57:09.283ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65352026-03-03T18:57:09.283ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65362026-03-03T18:57:09.284ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65372026-03-03T18:57:09.288ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5545 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = a9604ac4-3766-48eb-b9d6-76aa1dacbc40 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
65382026-03-03T18:57:09.289ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
65392026-03-03T18:57:09.294ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
65402026-03-03T18:57:09.294ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
65412026-03-03T18:57:09.294ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
65422026-03-03T18:57:09.294ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
65432026-03-03T18:57:09.294ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
65442026-03-03T18:57:09.294ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
65452026-03-03T18:57:09.294ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
65462026-03-03T18:57:09.295ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = fields_uuid
65472026-03-03T18:57:09.295ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
65482026-03-03T18:57:09.296ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65492026-03-03T18:57:09.296ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65502026-03-03T18:57:09.297ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65512026-03-03T18:57:09.302ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = measurements_histogramu64
65522026-03-03T18:57:09.302ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65532026-03-03T18:57:09.302ZDEBGtest_metrics (results-sink): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65542026-03-03T18:57:09.302ZDEBGtest_metrics (clickhouse-client): unrolling 10 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
65552026-03-03T18:57:09.306ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 20 sql = INSERT INTO oximeter.fields_string FORMAT Native
65562026-03-03T18:57:09.307ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
65572026-03-03T18:57:09.307ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
65582026-03-03T18:57:09.307ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65592026-03-03T18:57:09.307ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65602026-03-03T18:57:09.308ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65612026-03-03T18:57:09.309ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 20 table_name = fields_string
65622026-03-03T18:57:09.309ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
65632026-03-03T18:57:09.309ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
65642026-03-03T18:57:09.309ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65652026-03-03T18:57:09.309ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65662026-03-03T18:57:09.310ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65672026-03-03T18:57:09.311ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = fields_u16
65682026-03-03T18:57:09.311ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
65692026-03-03T18:57:09.311ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
65702026-03-03T18:57:09.313ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
65712026-03-03T18:57:09.314ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65722026-03-03T18:57:09.314ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65732026-03-03T18:57:09.314ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65742026-03-03T18:57:09.315ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = fields_uuid
65752026-03-03T18:57:09.315ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
65762026-03-03T18:57:09.315ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
65772026-03-03T18:57:09.315ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
65782026-03-03T18:57:09.315ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65792026-03-03T18:57:09.315ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65802026-03-03T18:57:09.316ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65812026-03-03T18:57:09.324ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = measurements_histogramu64
65822026-03-03T18:57:09.324ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65832026-03-03T18:57:09.324ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65842026-03-03T18:57:09.324ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
65852026-03-03T18:57:09.325ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
65862026-03-03T18:57:09.325ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
65872026-03-03T18:57:09.325ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65882026-03-03T18:57:09.325ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65892026-03-03T18:57:09.326ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65902026-03-03T18:57:09.333ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
65912026-03-03T18:57:09.333ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
65922026-03-03T18:57:09.333ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
65932026-03-03T18:57:09.335ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
65942026-03-03T18:57:09.335ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
65952026-03-03T18:57:09.335ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
65962026-03-03T18:57:09.335ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
65972026-03-03T18:57:09.335ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
65982026-03-03T18:57:09.335ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
65992026-03-03T18:57:09.336ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
66002026-03-03T18:57:09.338ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
66012026-03-03T18:57:09.338ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66022026-03-03T18:57:09.339ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
66032026-03-03T18:57:09.343ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
66042026-03-03T18:57:09.343ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
66052026-03-03T18:57:09.343ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
66062026-03-03T18:57:09.343ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
66072026-03-03T18:57:09.343ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
66082026-03-03T18:57:09.343ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
66092026-03-03T18:57:09.347ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
66102026-03-03T18:57:09.347ZDEBGtest_metrics (results-sink-cluster): inserting 2 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66112026-03-03T18:57:09.349ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
66122026-03-03T18:57:09.352ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
66132026-03-03T18:57:09.353ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
66142026-03-03T18:57:09.361ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10733361587332781639) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:09.282474699' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
66152026-03-03T18:57:09.388ZINFOtest_metrics (dropshot_external): request completed latency_us = 105233 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 17e80ccd-df60-42e8-88ce-5689773cedd1 response_code = 200 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.282474699Z&order=descending&limit=1
66162026-03-03T18:57:09.388ZINFOtest_metrics (external client test context): client received response status = 200
66172026-03-03T18:57:09.389ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66182026-03-03T18:57:09.389ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
66192026-03-03T18:57:09.389ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
66202026-03-03T18:57:09.389ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
66212026-03-03T18:57:09.389ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
66222026-03-03T18:57:09.389ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
66232026-03-03T18:57:09.389ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
66242026-03-03T18:57:09.389ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66252026-03-03T18:57:09.389ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
66262026-03-03T18:57:09.389ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = d9c93924-adeb-42b7-b765-58283bf9c230 uri = /913233fe-92a8-4635-9572-183f495429c4
66272026-03-03T18:57:09.390ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66282026-03-03T18:57:09.390ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66292026-03-03T18:57:09.390ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66302026-03-03T18:57:09.390ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66312026-03-03T18:57:09.390ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66322026-03-03T18:57:09.395ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5865 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = d9c93924-adeb-42b7-b765-58283bf9c230 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
66332026-03-03T18:57:09.396ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
66342026-03-03T18:57:09.403ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
66352026-03-03T18:57:09.403ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
66362026-03-03T18:57:09.403ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
66372026-03-03T18:57:09.403ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
66382026-03-03T18:57:09.404ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
66392026-03-03T18:57:09.404ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
66402026-03-03T18:57:09.404ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
66412026-03-03T18:57:09.404ZDEBGtest_metrics (results-sink): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66422026-03-03T18:57:09.410ZDEBGtest_metrics (clickhouse-client): unrolling 10 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
66432026-03-03T18:57:09.414ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 20 sql = INSERT INTO oximeter.fields_string FORMAT Native
66442026-03-03T18:57:09.415ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66452026-03-03T18:57:09.415ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66462026-03-03T18:57:09.416ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66472026-03-03T18:57:09.418ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 20 table_name = fields_string
66482026-03-03T18:57:09.418ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
66492026-03-03T18:57:09.419ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
66502026-03-03T18:57:09.419ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
66512026-03-03T18:57:09.419ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66522026-03-03T18:57:09.419ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66532026-03-03T18:57:09.420ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66542026-03-03T18:57:09.424ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = fields_u16
66552026-03-03T18:57:09.424ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
66562026-03-03T18:57:09.425ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
66572026-03-03T18:57:09.425ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66582026-03-03T18:57:09.425ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66592026-03-03T18:57:09.425ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66602026-03-03T18:57:09.427ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = fields_uuid
66612026-03-03T18:57:09.427ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
66622026-03-03T18:57:09.430ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
66632026-03-03T18:57:09.432ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
66642026-03-03T18:57:09.432ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66652026-03-03T18:57:09.432ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66662026-03-03T18:57:09.433ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66672026-03-03T18:57:09.436ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = measurements_histogramu64
66682026-03-03T18:57:09.436ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66692026-03-03T18:57:09.436ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66702026-03-03T18:57:09.436ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
66712026-03-03T18:57:09.437ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
66722026-03-03T18:57:09.438ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
66732026-03-03T18:57:09.438ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
66742026-03-03T18:57:09.438ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66752026-03-03T18:57:09.438ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66762026-03-03T18:57:09.438ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66772026-03-03T18:57:09.439ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
66782026-03-03T18:57:09.439ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
66792026-03-03T18:57:09.440ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
66802026-03-03T18:57:09.440ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66812026-03-03T18:57:09.440ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66822026-03-03T18:57:09.440ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66832026-03-03T18:57:09.441ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
66842026-03-03T18:57:09.441ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66852026-03-03T18:57:09.441ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
66862026-03-03T18:57:09.444ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
66872026-03-03T18:57:09.444ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66882026-03-03T18:57:09.444ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66892026-03-03T18:57:09.444ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66902026-03-03T18:57:09.444ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66912026-03-03T18:57:09.444ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66922026-03-03T18:57:09.444ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66932026-03-03T18:57:09.467ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
66942026-03-03T18:57:09.467ZDEBGtest_metrics (results-sink-cluster): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66952026-03-03T18:57:09.468ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66962026-03-03T18:57:09.472ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66972026-03-03T18:57:09.472ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66982026-03-03T18:57:09.472ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
66992026-03-03T18:57:09.472ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67002026-03-03T18:57:09.474ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67012026-03-03T18:57:09.474ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67022026-03-03T18:57:09.474ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67032026-03-03T18:57:09.474ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67042026-03-03T18:57:09.484ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67052026-03-03T18:57:09.488ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67062026-03-03T18:57:09.489ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67072026-03-03T18:57:09.489ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67082026-03-03T18:57:09.489ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67092026-03-03T18:57:09.493ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67102026-03-03T18:57:09.493ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67112026-03-03T18:57:09.493ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67122026-03-03T18:57:09.493ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67132026-03-03T18:57:09.493ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67142026-03-03T18:57:09.493ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67152026-03-03T18:57:09.493ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67162026-03-03T18:57:09.495ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67172026-03-03T18:57:09.499ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67182026-03-03T18:57:09.501ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
67192026-03-03T18:57:09.504ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:09.389092200' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
67202026-03-03T18:57:09.507ZINFOtest_metrics (dropshot_external): request completed latency_us = 117508 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 75422459-b1cf-44d5-86ce-5aa50c652962 response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.389092200Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67212026-03-03T18:57:09.507ZINFOtest_metrics (external client test context): client received response status = 200
67222026-03-03T18:57:09.507ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67232026-03-03T18:57:09.508ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
67242026-03-03T18:57:09.508ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
67252026-03-03T18:57:09.508ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
67262026-03-03T18:57:09.508ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
67272026-03-03T18:57:09.508ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
67282026-03-03T18:57:09.508ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
67292026-03-03T18:57:09.508ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67302026-03-03T18:57:09.508ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
67312026-03-03T18:57:09.508ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = f5564c2d-2508-4c82-b7c3-a1e8b562ba24 uri = /913233fe-92a8-4635-9572-183f495429c4
67322026-03-03T18:57:09.508ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67332026-03-03T18:57:09.508ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67342026-03-03T18:57:09.508ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67352026-03-03T18:57:09.509ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67362026-03-03T18:57:09.509ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67372026-03-03T18:57:09.514ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5812 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = f5564c2d-2508-4c82-b7c3-a1e8b562ba24 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
67382026-03-03T18:57:09.514ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
67392026-03-03T18:57:09.521ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
67402026-03-03T18:57:09.521ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
67412026-03-03T18:57:09.521ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
67422026-03-03T18:57:09.521ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
67432026-03-03T18:57:09.521ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
67442026-03-03T18:57:09.521ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
67452026-03-03T18:57:09.521ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
67462026-03-03T18:57:09.521ZDEBGtest_metrics (results-sink): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
67472026-03-03T18:57:09.521ZDEBGtest_metrics (clickhouse-client): unrolling 10 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
67482026-03-03T18:57:09.524ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 20 sql = INSERT INTO oximeter.fields_string FORMAT Native
67492026-03-03T18:57:09.528ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 20 table_name = fields_string
67502026-03-03T18:57:09.528ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
67512026-03-03T18:57:09.528ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = fields_u16
67522026-03-03T18:57:09.528ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
67532026-03-03T18:57:09.531ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = fields_uuid
67542026-03-03T18:57:09.532ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
67552026-03-03T18:57:09.532ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67562026-03-03T18:57:09.532ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67572026-03-03T18:57:09.532ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67582026-03-03T18:57:09.537ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
67592026-03-03T18:57:09.537ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
67602026-03-03T18:57:09.538ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67612026-03-03T18:57:09.538ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67622026-03-03T18:57:09.538ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67632026-03-03T18:57:09.539ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
67642026-03-03T18:57:09.539ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67652026-03-03T18:57:09.539ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67662026-03-03T18:57:09.540ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67672026-03-03T18:57:09.540ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = measurements_histogramu64
67682026-03-03T18:57:09.540ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
67692026-03-03T18:57:09.540ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
67702026-03-03T18:57:09.541ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
67712026-03-03T18:57:09.541ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
67722026-03-03T18:57:09.544ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
67732026-03-03T18:57:09.544ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
67742026-03-03T18:57:09.545ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67752026-03-03T18:57:09.545ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67762026-03-03T18:57:09.545ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67772026-03-03T18:57:09.547ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
67782026-03-03T18:57:09.547ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
67792026-03-03T18:57:09.556ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
67802026-03-03T18:57:09.556ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
67812026-03-03T18:57:09.556ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67822026-03-03T18:57:09.556ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67832026-03-03T18:57:09.556ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67842026-03-03T18:57:09.557ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
67852026-03-03T18:57:09.557ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
67862026-03-03T18:57:09.558ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
67872026-03-03T18:57:09.558ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67882026-03-03T18:57:09.558ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67892026-03-03T18:57:09.559ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67902026-03-03T18:57:09.560ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
67912026-03-03T18:57:09.566ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
67922026-03-03T18:57:09.566ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67932026-03-03T18:57:09.566ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67942026-03-03T18:57:09.567ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67952026-03-03T18:57:09.567ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67962026-03-03T18:57:09.567ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67972026-03-03T18:57:09.567ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67982026-03-03T18:57:09.567ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
67992026-03-03T18:57:09.568ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68002026-03-03T18:57:09.568ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68012026-03-03T18:57:09.568ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68022026-03-03T18:57:09.569ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68032026-03-03T18:57:09.570ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
68042026-03-03T18:57:09.570ZDEBGtest_metrics (results-sink-cluster): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
68052026-03-03T18:57:09.570ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68062026-03-03T18:57:09.570ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68072026-03-03T18:57:09.570ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68082026-03-03T18:57:09.570ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68092026-03-03T18:57:09.571ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68102026-03-03T18:57:09.573ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68112026-03-03T18:57:09.575ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68122026-03-03T18:57:09.575ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68132026-03-03T18:57:09.575ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68142026-03-03T18:57:09.576ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68152026-03-03T18:57:09.577ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68162026-03-03T18:57:09.577ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68172026-03-03T18:57:09.577ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68182026-03-03T18:57:09.577ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68192026-03-03T18:57:09.577ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68202026-03-03T18:57:09.578ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68212026-03-03T18:57:09.579ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68222026-03-03T18:57:09.582ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68232026-03-03T18:57:09.584ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
68242026-03-03T18:57:09.587ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:09.507857550' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
68252026-03-03T18:57:09.589ZINFOtest_metrics (dropshot_external): request completed latency_us = 80500 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 41eb7a85-a0d2-4e4d-b52c-bf4ed8b90b59 response_code = 200 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.507857550Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68262026-03-03T18:57:09.589ZINFOtest_metrics (external client test context): client received response status = 200
68272026-03-03T18:57:09.589ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68282026-03-03T18:57:09.595ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
68292026-03-03T18:57:09.596ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
68302026-03-03T18:57:09.596ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
68312026-03-03T18:57:09.596ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
68322026-03-03T18:57:09.596ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
68332026-03-03T18:57:09.596ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
68342026-03-03T18:57:09.596ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68352026-03-03T18:57:09.596ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
68362026-03-03T18:57:09.596ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 19d24c69-8deb-4169-8fd7-7be064d07c0c uri = /913233fe-92a8-4635-9572-183f495429c4
68372026-03-03T18:57:09.596ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68382026-03-03T18:57:09.596ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68392026-03-03T18:57:09.596ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68402026-03-03T18:57:09.596ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68412026-03-03T18:57:09.596ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68422026-03-03T18:57:09.602ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 11055 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 19d24c69-8deb-4169-8fd7-7be064d07c0c response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
68432026-03-03T18:57:09.606ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
68442026-03-03T18:57:09.613ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
68452026-03-03T18:57:09.613ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
68462026-03-03T18:57:09.613ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
68472026-03-03T18:57:09.613ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
68482026-03-03T18:57:09.613ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
68492026-03-03T18:57:09.613ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
68502026-03-03T18:57:09.613ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
68512026-03-03T18:57:09.613ZDEBGtest_metrics (results-sink): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
68522026-03-03T18:57:09.613ZDEBGtest_metrics (clickhouse-client): unrolling 10 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
68532026-03-03T18:57:09.615ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 20 sql = INSERT INTO oximeter.fields_string FORMAT Native
68542026-03-03T18:57:09.615ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68552026-03-03T18:57:09.615ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68562026-03-03T18:57:09.616ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68572026-03-03T18:57:09.617ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 20 table_name = fields_string
68582026-03-03T18:57:09.617ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
68592026-03-03T18:57:09.617ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
68602026-03-03T18:57:09.617ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
68612026-03-03T18:57:09.617ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68622026-03-03T18:57:09.617ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68632026-03-03T18:57:09.618ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68642026-03-03T18:57:09.619ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = fields_u16
68652026-03-03T18:57:09.619ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
68662026-03-03T18:57:09.620ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
68672026-03-03T18:57:09.620ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68682026-03-03T18:57:09.620ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68692026-03-03T18:57:09.620ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68702026-03-03T18:57:09.621ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = fields_uuid
68712026-03-03T18:57:09.621ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
68722026-03-03T18:57:09.623ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
68732026-03-03T18:57:09.625ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
68742026-03-03T18:57:09.625ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68752026-03-03T18:57:09.625ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68762026-03-03T18:57:09.625ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68772026-03-03T18:57:09.626ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = measurements_histogramu64
68782026-03-03T18:57:09.626ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
68792026-03-03T18:57:09.626ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
68802026-03-03T18:57:09.627ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
68812026-03-03T18:57:09.628ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
68822026-03-03T18:57:09.628ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
68832026-03-03T18:57:09.628ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
68842026-03-03T18:57:09.628ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68852026-03-03T18:57:09.628ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68862026-03-03T18:57:09.629ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68872026-03-03T18:57:09.633ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
68882026-03-03T18:57:09.633ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68892026-03-03T18:57:09.633ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68902026-03-03T18:57:09.633ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68912026-03-03T18:57:09.633ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
68922026-03-03T18:57:09.633ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
68932026-03-03T18:57:09.634ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
68942026-03-03T18:57:09.634ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
68952026-03-03T18:57:09.640ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
68962026-03-03T18:57:09.642ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
68972026-03-03T18:57:09.642ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68982026-03-03T18:57:09.642ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
68992026-03-03T18:57:09.642ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69002026-03-03T18:57:09.642ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69012026-03-03T18:57:09.642ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69022026-03-03T18:57:09.642ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69032026-03-03T18:57:09.644ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69042026-03-03T18:57:09.648ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69052026-03-03T18:57:09.648ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69062026-03-03T18:57:09.648ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69072026-03-03T18:57:09.648ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69082026-03-03T18:57:09.656ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69092026-03-03T18:57:09.656ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69102026-03-03T18:57:09.656ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69112026-03-03T18:57:09.657ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69122026-03-03T18:57:09.657ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69132026-03-03T18:57:09.659ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69142026-03-03T18:57:09.659ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69152026-03-03T18:57:09.659ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69162026-03-03T18:57:09.660ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69172026-03-03T18:57:09.666ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69182026-03-03T18:57:09.668ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69192026-03-03T18:57:09.668ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69202026-03-03T18:57:09.674ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69212026-03-03T18:57:09.674ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69222026-03-03T18:57:09.674ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69232026-03-03T18:57:09.674ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69242026-03-03T18:57:09.675ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
69252026-03-03T18:57:09.675ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
69262026-03-03T18:57:09.687ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69272026-03-03T18:57:09.691ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69282026-03-03T18:57:09.692ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
69292026-03-03T18:57:09.698ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:09.589555060' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
69302026-03-03T18:57:09.701ZINFOtest_metrics (dropshot_external): request completed latency_us = 110119 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da52fa75-90a2-44f5-9447-b4f80f588ff6 response_code = 200 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.589555060Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
69312026-03-03T18:57:09.701ZINFOtest_metrics (external client test context): client received response status = 200
69322026-03-03T18:57:09.701ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
69332026-03-03T18:57:09.701ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
69342026-03-03T18:57:09.701ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
69352026-03-03T18:57:09.701ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
69362026-03-03T18:57:09.701ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
69372026-03-03T18:57:09.701ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
69382026-03-03T18:57:09.702ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
69392026-03-03T18:57:09.703ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
69402026-03-03T18:57:09.703ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1 version = 2026021900.0.0
69412026-03-03T18:57:09.703ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 4b0368c4-e445-4eff-b6a7-4ecda50184d5 uri = /913233fe-92a8-4635-9572-183f495429c4
69422026-03-03T18:57:09.703ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
69432026-03-03T18:57:09.703ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
69442026-03-03T18:57:09.703ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
69452026-03-03T18:57:09.703ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
69462026-03-03T18:57:09.703ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
69472026-03-03T18:57:09.709ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6890 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 4b0368c4-e445-4eff-b6a7-4ecda50184d5 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
69482026-03-03T18:57:09.710ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
69492026-03-03T18:57:09.716ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
69502026-03-03T18:57:09.717ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
69512026-03-03T18:57:09.717ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
69522026-03-03T18:57:09.717ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
69532026-03-03T18:57:09.717ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
69542026-03-03T18:57:09.717ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
69552026-03-03T18:57:09.717ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
69562026-03-03T18:57:09.717ZDEBGtest_metrics (results-sink): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
69572026-03-03T18:57:09.717ZDEBGtest_metrics (clickhouse-client): unrolling 10 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
69582026-03-03T18:57:09.720ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 20 sql = INSERT INTO oximeter.fields_string FORMAT Native
69592026-03-03T18:57:09.721ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
69602026-03-03T18:57:09.721ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
69612026-03-03T18:57:09.722ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
69622026-03-03T18:57:09.727ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 20 table_name = fields_string
69632026-03-03T18:57:09.727ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
69642026-03-03T18:57:09.729ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
69652026-03-03T18:57:09.729ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
69662026-03-03T18:57:09.729ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
69672026-03-03T18:57:09.729ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
69682026-03-03T18:57:09.731ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
69692026-03-03T18:57:09.732ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = fields_u16
69702026-03-03T18:57:09.732ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
69712026-03-03T18:57:09.733ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
69722026-03-03T18:57:09.733ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
69732026-03-03T18:57:09.733ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
69742026-03-03T18:57:09.734ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
69752026-03-03T18:57:09.736ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
69762026-03-03T18:57:09.738ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
69772026-03-03T18:57:09.738ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
69782026-03-03T18:57:09.738ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
69792026-03-03T18:57:09.739ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
69802026-03-03T18:57:09.739ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = fields_uuid
69812026-03-03T18:57:09.739ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
69822026-03-03T18:57:09.740ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
69832026-03-03T18:57:09.740ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
69842026-03-03T18:57:09.740ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
69852026-03-03T18:57:09.740ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
69862026-03-03T18:57:09.740ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
69872026-03-03T18:57:09.742ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 10 table_name = measurements_histogramu64
69882026-03-03T18:57:09.742ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
69892026-03-03T18:57:09.742ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
69902026-03-03T18:57:09.743ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
69912026-03-03T18:57:09.743ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
69922026-03-03T18:57:09.743ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
69932026-03-03T18:57:09.743ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
69942026-03-03T18:57:09.743ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
69952026-03-03T18:57:09.744ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
69962026-03-03T18:57:09.745ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
69972026-03-03T18:57:09.750ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
69982026-03-03T18:57:09.751ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
69992026-03-03T18:57:09.751ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70002026-03-03T18:57:09.751ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70012026-03-03T18:57:09.751ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70022026-03-03T18:57:09.751ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70032026-03-03T18:57:09.751ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70042026-03-03T18:57:09.751ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
70052026-03-03T18:57:09.751ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
70062026-03-03T18:57:09.754ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
70072026-03-03T18:57:09.755ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
70082026-03-03T18:57:09.755ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70092026-03-03T18:57:09.755ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70102026-03-03T18:57:09.755ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70112026-03-03T18:57:09.755ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70122026-03-03T18:57:09.757ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70132026-03-03T18:57:09.763ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70142026-03-03T18:57:09.763ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70152026-03-03T18:57:09.763ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70162026-03-03T18:57:09.764ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70172026-03-03T18:57:09.764ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70182026-03-03T18:57:09.764ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70192026-03-03T18:57:09.766ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70202026-03-03T18:57:09.767ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70212026-03-03T18:57:09.767ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70222026-03-03T18:57:09.767ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70232026-03-03T18:57:09.769ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70242026-03-03T18:57:09.771ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70252026-03-03T18:57:09.773ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
70262026-03-03T18:57:09.776ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
70272026-03-03T18:57:09.776ZDEBGtest_metrics (results-sink-cluster): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
70282026-03-03T18:57:09.777ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:09.701542800' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
70292026-03-03T18:57:09.804ZINFOtest_metrics (dropshot_external): request completed latency_us = 101823 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 01162e40-1a28-4cce-aaec-63fcd076760f response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.701542800Z&order=descending&limit=1
70302026-03-03T18:57:09.804ZINFOtest_metrics (external client test context): client received response status = 200
70312026-03-03T18:57:09.804ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
70322026-03-03T18:57:09.804ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
70332026-03-03T18:57:09.805ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
70342026-03-03T18:57:09.805ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
70352026-03-03T18:57:09.805ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
70362026-03-03T18:57:09.806ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
70372026-03-03T18:57:09.806ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
70382026-03-03T18:57:09.806ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
70392026-03-03T18:57:09.806ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1 version = 2026021900.0.0
70402026-03-03T18:57:09.806ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 83a23e37-e629-49b2-a440-f83ce87679e5 uri = /913233fe-92a8-4635-9572-183f495429c4
70412026-03-03T18:57:09.806ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
70422026-03-03T18:57:09.806ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
70432026-03-03T18:57:09.806ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
70442026-03-03T18:57:09.806ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
70452026-03-03T18:57:09.823ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
70462026-03-03T18:57:09.827ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 22384 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 83a23e37-e629-49b2-a440-f83ce87679e5 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
70472026-03-03T18:57:09.828ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
70482026-03-03T18:57:09.835ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
70492026-03-03T18:57:09.835ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
70502026-03-03T18:57:09.835ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
70512026-03-03T18:57:09.835ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
70522026-03-03T18:57:09.835ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
70532026-03-03T18:57:09.835ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
70542026-03-03T18:57:09.835ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
70552026-03-03T18:57:09.836ZDEBGtest_metrics (results-sink): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
70562026-03-03T18:57:09.836ZDEBGtest_metrics (clickhouse-client): unrolling 11 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
70572026-03-03T18:57:09.840ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_string FORMAT Native
70582026-03-03T18:57:09.841ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
70592026-03-03T18:57:09.841ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
70602026-03-03T18:57:09.842ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
70612026-03-03T18:57:09.846ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
70622026-03-03T18:57:09.846ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
70632026-03-03T18:57:09.846ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
70642026-03-03T18:57:09.846ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
70652026-03-03T18:57:09.847ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
70662026-03-03T18:57:09.847ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 22 table_name = fields_string
70672026-03-03T18:57:09.847ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
70682026-03-03T18:57:09.848ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
70692026-03-03T18:57:09.849ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
70702026-03-03T18:57:09.849ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
70712026-03-03T18:57:09.850ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
70722026-03-03T18:57:09.851ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 11 table_name = fields_u16
70732026-03-03T18:57:09.851ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
70742026-03-03T18:57:09.852ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
70752026-03-03T18:57:09.856ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
70762026-03-03T18:57:09.856ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
70772026-03-03T18:57:09.856ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
70782026-03-03T18:57:09.857ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
70792026-03-03T18:57:09.861ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 11 table_name = fields_uuid
70802026-03-03T18:57:09.861ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 11 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
70812026-03-03T18:57:09.861ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
70822026-03-03T18:57:09.861ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
70832026-03-03T18:57:09.861ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
70842026-03-03T18:57:09.861ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
70852026-03-03T18:57:09.861ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
70862026-03-03T18:57:09.862ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
70872026-03-03T18:57:09.862ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
70882026-03-03T18:57:09.862ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
70892026-03-03T18:57:09.862ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
70902026-03-03T18:57:09.866ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 11 table_name = measurements_histogramu64
70912026-03-03T18:57:09.866ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
70922026-03-03T18:57:09.866ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
70932026-03-03T18:57:09.866ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
70942026-03-03T18:57:09.866ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
70952026-03-03T18:57:09.866ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
70962026-03-03T18:57:09.868ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
70972026-03-03T18:57:09.868ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
70982026-03-03T18:57:09.868ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
70992026-03-03T18:57:09.868ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71002026-03-03T18:57:09.868ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71012026-03-03T18:57:09.868ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71022026-03-03T18:57:09.869ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71032026-03-03T18:57:09.881ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
71042026-03-03T18:57:09.881ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
71052026-03-03T18:57:09.882ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71062026-03-03T18:57:09.882ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71072026-03-03T18:57:09.882ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71082026-03-03T18:57:09.883ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71092026-03-03T18:57:09.885ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
71102026-03-03T18:57:09.887ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
71112026-03-03T18:57:09.896ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71122026-03-03T18:57:09.899ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71132026-03-03T18:57:09.899ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71142026-03-03T18:57:09.899ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71152026-03-03T18:57:09.899ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71162026-03-03T18:57:09.899ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71172026-03-03T18:57:09.899ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71182026-03-03T18:57:09.904ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
71192026-03-03T18:57:09.904ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
71202026-03-03T18:57:09.904ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71212026-03-03T18:57:09.904ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71222026-03-03T18:57:09.904ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71232026-03-03T18:57:09.904ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71242026-03-03T18:57:09.904ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71252026-03-03T18:57:09.906ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71262026-03-03T18:57:09.917ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
71272026-03-03T18:57:09.923ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:09.804639385' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
71282026-03-03T18:57:09.927ZINFOtest_metrics (dropshot_external): request completed latency_us = 122344 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 73e29b7f-ac7d-457e-924e-8a493ccf5f31 response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.804639385Z&order=descending&limit=1
71292026-03-03T18:57:09.927ZINFOtest_metrics (external client test context): client received response status = 200
71302026-03-03T18:57:09.928ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
71312026-03-03T18:57:09.928ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
71322026-03-03T18:57:09.928ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
71332026-03-03T18:57:09.928ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
71342026-03-03T18:57:09.928ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
71352026-03-03T18:57:09.928ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
71362026-03-03T18:57:09.928ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
71372026-03-03T18:57:09.928ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
71382026-03-03T18:57:09.928ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1 version = 2026021900.0.0
71392026-03-03T18:57:09.928ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = e1c3c182-b111-457e-b204-94a9f064de30 uri = /913233fe-92a8-4635-9572-183f495429c4
71402026-03-03T18:57:09.929ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
71412026-03-03T18:57:09.929ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
71422026-03-03T18:57:09.929ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
71432026-03-03T18:57:09.929ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
71442026-03-03T18:57:09.929ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
71452026-03-03T18:57:09.935ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6785 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = e1c3c182-b111-457e-b204-94a9f064de30 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
71462026-03-03T18:57:09.936ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
71472026-03-03T18:57:09.942ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
71482026-03-03T18:57:09.942ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
71492026-03-03T18:57:09.942ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
71502026-03-03T18:57:09.942ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
71512026-03-03T18:57:09.943ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
71522026-03-03T18:57:09.943ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
71532026-03-03T18:57:09.943ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
71542026-03-03T18:57:09.943ZDEBGtest_metrics (results-sink): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
71552026-03-03T18:57:09.943ZDEBGtest_metrics (clickhouse-client): unrolling 11 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
71562026-03-03T18:57:09.947ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_string FORMAT Native
71572026-03-03T18:57:09.948ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
71582026-03-03T18:57:09.948ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
71592026-03-03T18:57:09.949ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
71602026-03-03T18:57:09.950ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 22 table_name = fields_string
71612026-03-03T18:57:09.950ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
71622026-03-03T18:57:09.951ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 11 table_name = fields_u16
71632026-03-03T18:57:09.951ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
71642026-03-03T18:57:09.952ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
71652026-03-03T18:57:09.952ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
71662026-03-03T18:57:09.952ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
71672026-03-03T18:57:09.952ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
71682026-03-03T18:57:09.952ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
71692026-03-03T18:57:09.954ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 11 table_name = fields_uuid
71702026-03-03T18:57:09.954ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 11 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
71712026-03-03T18:57:09.954ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
71722026-03-03T18:57:09.954ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
71732026-03-03T18:57:09.954ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
71742026-03-03T18:57:09.954ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
71752026-03-03T18:57:09.957ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
71762026-03-03T18:57:09.958ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
71772026-03-03T18:57:09.959ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
71782026-03-03T18:57:09.959ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
71792026-03-03T18:57:09.959ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
71802026-03-03T18:57:09.960ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 11 table_name = measurements_histogramu64
71812026-03-03T18:57:09.960ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
71822026-03-03T18:57:09.960ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
71832026-03-03T18:57:09.960ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
71842026-03-03T18:57:09.961ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
71852026-03-03T18:57:09.961ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
71862026-03-03T18:57:09.961ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
71872026-03-03T18:57:09.961ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
71882026-03-03T18:57:09.961ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
71892026-03-03T18:57:09.962ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
71902026-03-03T18:57:09.964ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
71912026-03-03T18:57:09.964ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
71922026-03-03T18:57:09.964ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
71932026-03-03T18:57:09.964ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
71942026-03-03T18:57:09.964ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
71952026-03-03T18:57:09.964ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
71962026-03-03T18:57:09.965ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
71972026-03-03T18:57:09.969ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
71982026-03-03T18:57:09.969ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
71992026-03-03T18:57:09.969ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72002026-03-03T18:57:09.969ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72012026-03-03T18:57:09.969ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72022026-03-03T18:57:09.969ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72032026-03-03T18:57:09.969ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72042026-03-03T18:57:09.969ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
72052026-03-03T18:57:09.969ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
72062026-03-03T18:57:09.970ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72072026-03-03T18:57:09.970ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72082026-03-03T18:57:09.970ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72092026-03-03T18:57:09.970ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72102026-03-03T18:57:09.973ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72112026-03-03T18:57:09.975ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72122026-03-03T18:57:09.975ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72132026-03-03T18:57:09.975ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72142026-03-03T18:57:09.975ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72152026-03-03T18:57:09.975ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72162026-03-03T18:57:09.975ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72172026-03-03T18:57:09.977ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72182026-03-03T18:57:09.977ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72192026-03-03T18:57:09.977ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72202026-03-03T18:57:09.978ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72212026-03-03T18:57:09.979ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72222026-03-03T18:57:09.981ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72232026-03-03T18:57:09.983ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
72242026-03-03T18:57:09.986ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:09.928079392' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
72252026-03-03T18:57:09.986ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
72262026-03-03T18:57:09.986ZDEBGtest_metrics (results-sink-cluster): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
72272026-03-03T18:57:09.988ZINFOtest_metrics (dropshot_external): request completed latency_us = 59674 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 153a10e1-8f84-434c-bbd0-61f0af7c1805 response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:09.928079392Z&order=descending&limit=1
72282026-03-03T18:57:09.988ZINFOtest_metrics (external client test context): client received response status = 200
72292026-03-03T18:57:09.988ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:37769/v1/projects
72302026-03-03T18:57:09.989ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 uri = /v1/projects
72312026-03-03T18:57:09.989ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 uri = /v1/projects version = 2026021900.0.0
72322026-03-03T18:57:09.989ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 uri = /v1/projects
72332026-03-03T18:57:09.989ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/projects
72342026-03-03T18:57:09.989ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72352026-03-03T18:57:09.989ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72362026-03-03T18:57:09.990ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72372026-03-03T18:57:09.991ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72382026-03-03T18:57:09.991ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72392026-03-03T18:57:09.992ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72402026-03-03T18:57:09.993ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
72412026-03-03T18:57:09.993ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
72422026-03-03T18:57:09.993ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72432026-03-03T18:57:09.993ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72442026-03-03T18:57:09.994ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72452026-03-03T18:57:10.004ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
72462026-03-03T18:57:10.005ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72472026-03-03T18:57:10.005ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72482026-03-03T18:57:10.005ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72492026-03-03T18:57:10.007ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
72502026-03-03T18:57:10.010ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
72512026-03-03T18:57:10.010ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72522026-03-03T18:57:10.010ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72532026-03-03T18:57:10.011ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72542026-03-03T18:57:10.013ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
72552026-03-03T18:57:10.013ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
72562026-03-03T18:57:10.013ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72572026-03-03T18:57:10.013ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72582026-03-03T18:57:10.013ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72592026-03-03T18:57:10.015ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
72602026-03-03T18:57:10.015ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72612026-03-03T18:57:10.015ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72622026-03-03T18:57:10.015ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72632026-03-03T18:57:10.016ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
72642026-03-03T18:57:10.019ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
72652026-03-03T18:57:10.019ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 uri = /v1/projects
72662026-03-03T18:57:10.019ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72672026-03-03T18:57:10.019ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72682026-03-03T18:57:10.019ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72692026-03-03T18:57:10.019ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72702026-03-03T18:57:10.019ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72712026-03-03T18:57:10.021ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72722026-03-03T18:57:10.023ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72732026-03-03T18:57:10.023ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72742026-03-03T18:57:10.023ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72752026-03-03T18:57:10.023ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72762026-03-03T18:57:10.026ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72772026-03-03T18:57:10.026ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72782026-03-03T18:57:10.026ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72792026-03-03T18:57:10.026ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72802026-03-03T18:57:10.026ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72812026-03-03T18:57:10.028ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72822026-03-03T18:57:10.028ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72832026-03-03T18:57:10.028ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72842026-03-03T18:57:10.028ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72852026-03-03T18:57:10.033ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72862026-03-03T18:57:10.036ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72872026-03-03T18:57:10.037ZINFOtest_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
72882026-03-03T18:57:10.037ZINFOtest_metrics (SagaExecutor): preparing saga saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create
72892026-03-03T18:57:10.037ZINFOtest_metrics (SEC): saga create dag = {"end_node":21,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[14,15,null],[15,16,null],[16,17,null],[17,18,null],[2,3,null],[18,19,null],[20,0,null],[19,21,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSubnetRouteId","name":"subnet_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultInternetGatewayId","name":"default_internet_gateway_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet_route","label":"VpcCreateSubnetRoute","name":"route"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_create_gateway","label":"VpcCreateGateway","name":"gateway"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"001de000-5110-4000-8000-000000000000","lookup_type":{"ById":"001de000-5110-4000-8000-000000000000"},"parent":null},"project_create":{"description":"a pier","name":"p-1"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"project-create","start_node":20} saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
72902026-03-03T18:57:10.037ZINFOtest_metrics (SecStore): creating saga saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create
72912026-03-03T18:57:10.055ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
72922026-03-03T18:57:10.074ZINFOtest_metrics (SagaExecutor): starting saga saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create
72932026-03-03T18:57:10.074ZINFOtest_metrics (SEC): saga start saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
72942026-03-03T18:57:10.074ZDEBGtest_metrics (SEC): saga log event new_state = N020 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
72952026-03-03T18:57:10.074ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 20 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
72962026-03-03T18:57:10.080ZDEBGtest_metrics (SEC): saga log event new_state = N020 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
72972026-03-03T18:57:10.080ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 20 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
72982026-03-03T18:57:10.082ZDEBGtest_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
72992026-03-03T18:57:10.083ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73002026-03-03T18:57:10.083ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73012026-03-03T18:57:10.083ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73022026-03-03T18:57:10.083ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73032026-03-03T18:57:10.083ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73042026-03-03T18:57:10.084ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73052026-03-03T18:57:10.087ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
73062026-03-03T18:57:10.087ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
73072026-03-03T18:57:10.087ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73082026-03-03T18:57:10.087ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73092026-03-03T18:57:10.087ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73102026-03-03T18:57:10.091ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73112026-03-03T18:57:10.093ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73122026-03-03T18:57:10.096ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73132026-03-03T18:57:10.096ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73142026-03-03T18:57:10.096ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73152026-03-03T18:57:10.096ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73162026-03-03T18:57:10.102ZDEBGtest_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
73172026-03-03T18:57:10.102ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "name": String("p-1"), "time_created": String("2026-03-03T18:57:10.083562Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.083562Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}]) node_id = 0 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73182026-03-03T18:57:10.104ZDEBGtest_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
73192026-03-03T18:57:10.104ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73202026-03-03T18:57:10.106ZDEBGtest_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
73212026-03-03T18:57:10.106ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd10:6312:e1c::/48"), "name": String("default")}}) node_id = 1 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73222026-03-03T18:57:10.107ZDEBGtest_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
73232026-03-03T18:57:10.107ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73242026-03-03T18:57:10.109ZDEBGtest_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
73252026-03-03T18:57:10.109ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73262026-03-03T18:57:10.111ZDEBGtest_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
73272026-03-03T18:57:10.111ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73282026-03-03T18:57:10.112ZDEBGtest_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
73292026-03-03T18:57:10.112ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")) node_id = 3 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73302026-03-03T18:57:10.115ZDEBGtest_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
73312026-03-03T18:57:10.115ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73322026-03-03T18:57:10.117ZDEBGtest_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
73332026-03-03T18:57:10.117ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("602a71f8-025d-4629-ad7c-2ab5eb222ba4")) node_id = 4 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73342026-03-03T18:57:10.120ZDEBGtest_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
73352026-03-03T18:57:10.121ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73362026-03-03T18:57:10.122ZDEBGtest_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
73372026-03-03T18:57:10.122ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("dcfb83ae-ca0c-4c22-bafd-09d967ce474a")) node_id = 5 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73382026-03-03T18:57:10.123ZDEBGtest_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
73392026-03-03T18:57:10.123ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73402026-03-03T18:57:10.125ZDEBGtest_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
73412026-03-03T18:57:10.125ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("13824ae5-30f5-4cd4-bde2-548bc30fcc1f")) node_id = 6 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73422026-03-03T18:57:10.126ZDEBGtest_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
73432026-03-03T18:57:10.126ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73442026-03-03T18:57:10.127ZDEBGtest_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
73452026-03-03T18:57:10.128ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("09a3f6c2-0a40-4d38-a2a3-75ec22430161")) node_id = 7 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73462026-03-03T18:57:10.129ZDEBGtest_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
73472026-03-03T18:57:10.129ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73482026-03-03T18:57:10.130ZDEBGtest_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
73492026-03-03T18:57:10.130ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("954cc302-beec-4b31-9846-5142d8600ee1")) node_id = 8 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73502026-03-03T18:57:10.131ZDEBGtest_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
73512026-03-03T18:57:10.131ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73522026-03-03T18:57:10.132ZDEBGtest_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
73532026-03-03T18:57:10.132ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("55ae9f25-759e-470b-865c-709fb5391660")) node_id = 9 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73542026-03-03T18:57:10.134ZDEBGtest_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
73552026-03-03T18:57:10.134ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73562026-03-03T18:57:10.135ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73572026-03-03T18:57:10.135ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73582026-03-03T18:57:10.135ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73592026-03-03T18:57:10.135ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73602026-03-03T18:57:10.136ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73612026-03-03T18:57:10.137ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73622026-03-03T18:57:10.137ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73632026-03-03T18:57:10.137ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73642026-03-03T18:57:10.139ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73652026-03-03T18:57:10.140ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73662026-03-03T18:57:10.140ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73672026-03-03T18:57:10.140ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73682026-03-03T18:57:10.141ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73692026-03-03T18:57:10.143ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73702026-03-03T18:57:10.147ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") } result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73712026-03-03T18:57:10.147ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73722026-03-03T18:57:10.147ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73732026-03-03T18:57:10.147ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73742026-03-03T18:57:10.152ZDEBGtest_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
73752026-03-03T18:57:10.152ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "name": String("default"), "time_created": String("2026-03-03T18:57:10.135688Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.135688Z")}, "ipv6_prefix": String("fd10:6312:e1c::/48"), "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "subnet_gen": Number(1), "system_router_id": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4"), "vni": Number(5991081)}]) node_id = 10 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73762026-03-03T18:57:10.154ZDEBGtest_metrics (SEC): saga log event new_state = N011 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
73772026-03-03T18:57:10.154ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
73782026-03-03T18:57:10.155ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73792026-03-03T18:57:10.155ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73802026-03-03T18:57:10.155ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73812026-03-03T18:57:10.155ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73822026-03-03T18:57:10.156ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73832026-03-03T18:57:10.157ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73842026-03-03T18:57:10.157ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73852026-03-03T18:57:10.157ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73862026-03-03T18:57:10.158ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73872026-03-03T18:57:10.159ZINFOtest_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
73882026-03-03T18:57:10.160ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
73892026-03-03T18:57:10.160ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73902026-03-03T18:57:10.160ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73912026-03-03T18:57:10.160ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73922026-03-03T18:57:10.161ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73932026-03-03T18:57:10.161ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = bbe5210d-1a2b-4555-829b-595ca57fa1f5 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
73942026-03-03T18:57:10.161ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = bbe5210d-1a2b-4555-829b-595ca57fa1f5 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
73952026-03-03T18:57:10.161ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = bbe5210d-1a2b-4555-829b-595ca57fa1f5 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
73962026-03-03T18:57:10.161ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = bbe5210d-1a2b-4555-829b-595ca57fa1f5 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
73972026-03-03T18:57:10.162ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = bbe5210d-1a2b-4555-829b-595ca57fa1f5 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
73982026-03-03T18:57:10.163ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
73992026-03-03T18:57:10.167ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74002026-03-03T18:57:10.168ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74012026-03-03T18:57:10.168ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74022026-03-03T18:57:10.168ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74032026-03-03T18:57:10.169ZINFOtest_metrics (dropshot_internal): request completed latency_us = 7513 local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = bbe5210d-1a2b-4555-829b-595ca57fa1f5 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
74042026-03-03T18:57:10.169ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbe5210d-1a2b-4555-829b-595ca57fa1f5", "content-length": "405", "date": "Tue, 03 Mar 2026 18:57:10 GMT"} })
74052026-03-03T18:57:10.169ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
74062026-03-03T18:57:10.170ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 62523787-0ec0-4610-98ef-2a2bcbd443e6 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
74072026-03-03T18:57:10.170ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 62523787-0ec0-4610-98ef-2a2bcbd443e6 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D version = 1.0.0
74082026-03-03T18:57:10.170ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 62523787-0ec0-4610-98ef-2a2bcbd443e6 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
74092026-03-03T18:57:10.170ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 62523787-0ec0-4610-98ef-2a2bcbd443e6 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
74102026-03-03T18:57:10.170ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 62523787-0ec0-4610-98ef-2a2bcbd443e6 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
74112026-03-03T18:57:10.171ZDEBGtest_metrics (SEC): saga log event new_state = N011 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
74122026-03-03T18:57:10.171ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4"), "lookup_type": Object {"ById": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4")}, "parent": Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}) node_id = 11 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
74132026-03-03T18:57:10.172ZINFOtest_metrics (dropshot_internal): request completed latency_us = 2686 local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 62523787-0ec0-4610-98ef-2a2bcbd443e6 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
74142026-03-03T18:57:10.173ZDEBGtest_metrics (SEC): saga log event new_state = N012 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
74152026-03-03T18:57:10.173ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
74162026-03-03T18:57:10.173ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "62523787-0ec0-4610-98ef-2a2bcbd443e6", "content-length": "29", "date": "Tue, 03 Mar 2026 18:57:10 GMT"} })
74172026-03-03T18:57:10.173ZTRACtest_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4
74182026-03-03T18:57:10.173ZTRACtest_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
74192026-03-03T18:57:10.173ZINFOtest_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
74202026-03-03T18:57:10.175ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") }, key: 602a71f8-025d-4629-ad7c-2ab5eb222ba4, lookup_type: ById(602a71f8-025d-4629-ad7c-2ab5eb222ba4) } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74212026-03-03T18:57:10.175ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74222026-03-03T18:57:10.176ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74232026-03-03T18:57:10.176ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74242026-03-03T18:57:10.176ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74252026-03-03T18:57:10.178ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74262026-03-03T18:57:10.178ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74272026-03-03T18:57:10.178ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74282026-03-03T18:57:10.178ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74292026-03-03T18:57:10.180ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74302026-03-03T18:57:10.180ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74312026-03-03T18:57:10.180ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74322026-03-03T18:57:10.181ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74332026-03-03T18:57:10.182ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74342026-03-03T18:57:10.187ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") }, key: 602a71f8-025d-4629-ad7c-2ab5eb222ba4, lookup_type: ById(602a71f8-025d-4629-ad7c-2ab5eb222ba4) } result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74352026-03-03T18:57:10.187ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74362026-03-03T18:57:10.187ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74372026-03-03T18:57:10.188ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74382026-03-03T18:57:10.188ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
74392026-03-03T18:57:10.188ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
74402026-03-03T18:57:10.188ZDEBGtest_metrics (results-sink-cluster): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
74412026-03-03T18:57:10.191ZDEBGtest_metrics (SEC): saga log event new_state = N012 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
74422026-03-03T18:57:10.191ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
74432026-03-03T18:57:10.192ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
74442026-03-03T18:57:10.192ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
74452026-03-03T18:57:10.193ZDEBGtest_metrics (SEC): saga log event new_state = N013 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
74462026-03-03T18:57:10.193ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
74472026-03-03T18:57:10.198ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
74482026-03-03T18:57:10.198ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
74492026-03-03T18:57:10.198ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
74502026-03-03T18:57:10.198ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
74512026-03-03T18:57:10.201ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") }, key: 602a71f8-025d-4629-ad7c-2ab5eb222ba4, lookup_type: ById(602a71f8-025d-4629-ad7c-2ab5eb222ba4) } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74522026-03-03T18:57:10.201ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74532026-03-03T18:57:10.201ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74542026-03-03T18:57:10.201ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74552026-03-03T18:57:10.201ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74562026-03-03T18:57:10.203ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74572026-03-03T18:57:10.203ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74582026-03-03T18:57:10.203ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74592026-03-03T18:57:10.204ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74602026-03-03T18:57:10.205ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74612026-03-03T18:57:10.205ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74622026-03-03T18:57:10.205ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74632026-03-03T18:57:10.206ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74642026-03-03T18:57:10.209ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74652026-03-03T18:57:10.215ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") }, key: 602a71f8-025d-4629-ad7c-2ab5eb222ba4, lookup_type: ById(602a71f8-025d-4629-ad7c-2ab5eb222ba4) } result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74662026-03-03T18:57:10.215ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74672026-03-03T18:57:10.215ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74682026-03-03T18:57:10.215ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74692026-03-03T18:57:10.222ZDEBGtest_metrics (SEC): saga log event new_state = N013 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
74702026-03-03T18:57:10.222ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
74712026-03-03T18:57:10.231ZDEBGtest_metrics (SEC): saga log event new_state = N014 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
74722026-03-03T18:57:10.231ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
74732026-03-03T18:57:10.234ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74742026-03-03T18:57:10.234ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74752026-03-03T18:57:10.234ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74762026-03-03T18:57:10.234ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74772026-03-03T18:57:10.234ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74782026-03-03T18:57:10.236ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74792026-03-03T18:57:10.236ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74802026-03-03T18:57:10.236ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74812026-03-03T18:57:10.237ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74822026-03-03T18:57:10.254ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74832026-03-03T18:57:10.254ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74842026-03-03T18:57:10.254ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74852026-03-03T18:57:10.255ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74862026-03-03T18:57:10.257ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74872026-03-03T18:57:10.262ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74882026-03-03T18:57:10.264ZDEBGtest_metrics (SEC): saga log event new_state = N014 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
74892026-03-03T18:57:10.264ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("954cc302-beec-4b31-9846-5142d8600ee1"), "lookup_type": Object {"ById": String("954cc302-beec-4b31-9846-5142d8600ee1")}, "parent": Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("954cc302-beec-4b31-9846-5142d8600ee1"), "name": String("default"), "time_created": String("2026-03-03T18:57:10.234301Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.234301Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd10:6312:e1c::/64"), "rcgen": Number(1), "vpc_id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")}]) node_id = 14 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
74902026-03-03T18:57:10.271ZDEBGtest_metrics (SEC): saga log event new_state = N015 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
74912026-03-03T18:57:10.271ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 15 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
74922026-03-03T18:57:10.276ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") }, key: 602a71f8-025d-4629-ad7c-2ab5eb222ba4, lookup_type: ById(602a71f8-025d-4629-ad7c-2ab5eb222ba4) } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74932026-03-03T18:57:10.276ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74942026-03-03T18:57:10.276ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74952026-03-03T18:57:10.276ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74962026-03-03T18:57:10.277ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74972026-03-03T18:57:10.279ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74982026-03-03T18:57:10.279ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
74992026-03-03T18:57:10.279ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75002026-03-03T18:57:10.279ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75012026-03-03T18:57:10.288ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75022026-03-03T18:57:10.289ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75032026-03-03T18:57:10.289ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75042026-03-03T18:57:10.289ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75052026-03-03T18:57:10.289ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
75062026-03-03T18:57:10.290ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
75072026-03-03T18:57:10.297ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75082026-03-03T18:57:10.303ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") }, key: 602a71f8-025d-4629-ad7c-2ab5eb222ba4, lookup_type: ById(602a71f8-025d-4629-ad7c-2ab5eb222ba4) } result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75092026-03-03T18:57:10.303ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75102026-03-03T18:57:10.303ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75112026-03-03T18:57:10.304ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75122026-03-03T18:57:10.315ZDEBGtest_metrics (SEC): saga log event new_state = N015 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
75132026-03-03T18:57:10.315ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("09a3f6c2-0a40-4d38-a2a3-75ec22430161"), "lookup_type": Object {"ById": String("954cc302-beec-4b31-9846-5142d8600ee1")}, "parent": Object {"key": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4"), "lookup_type": Object {"ById": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4")}, "parent": Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}) node_id = 15 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
75142026-03-03T18:57:10.317ZDEBGtest_metrics (SEC): saga log event new_state = N016 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
75152026-03-03T18:57:10.317ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 16 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
75162026-03-03T18:57:10.327ZDEBGtest_metrics (nexus): default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 1ea6046c-15a0-4fcd-b11f-4551813ccfc6, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2026-03-03T18:57:10.327162Z, time_modified: 2026-03-03T18:57:10.327162Z, time_deleted: None }, vpc_id: d828fef3-ec51-44c7-b4a4-a37c1176c89a, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 807f3432-8d83-4255-a58b-55e2dbe55d8f, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2026-03-03T18:57:10.327186Z, time_modified: 2026-03-03T18:57:10.327186Z, time_deleted: None }, vpc_id: d828fef3-ec51-44c7-b4a4-a37c1176c89a, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: f83bed25-2e85-4c08-88d3-f9ab00f1d153, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2026-03-03T18:57:10.327195Z, time_modified: 2026-03-03T18:57:10.327195Z, time_deleted: None }, vpc_id: d828fef3-ec51-44c7-b4a4-a37c1176c89a, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp(None))]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
75172026-03-03T18:57:10.327ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75182026-03-03T18:57:10.327ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75192026-03-03T18:57:10.327ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75202026-03-03T18:57:10.327ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75212026-03-03T18:57:10.327ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75222026-03-03T18:57:10.329ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75232026-03-03T18:57:10.329ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75242026-03-03T18:57:10.330ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75252026-03-03T18:57:10.330ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75262026-03-03T18:57:10.333ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75272026-03-03T18:57:10.333ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75282026-03-03T18:57:10.333ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75292026-03-03T18:57:10.333ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75302026-03-03T18:57:10.336ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75312026-03-03T18:57:10.344ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75322026-03-03T18:57:10.344ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75332026-03-03T18:57:10.344ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75342026-03-03T18:57:10.344ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75352026-03-03T18:57:10.390ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
75362026-03-03T18:57:10.390ZDEBGtest_metrics (results-sink-cluster): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
75372026-03-03T18:57:10.412ZDEBGtest_metrics (SEC): saga log event new_state = N016 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
75382026-03-03T18:57:10.412ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("1ea6046c-15a0-4fcd-b11f-4551813ccfc6"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T18:57:10.327162Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.327162Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("807f3432-8d83-4255-a58b-55e2dbe55d8f"), "name": String("allow-ssh"), "time_created": String("2026-03-03T18:57:10.327186Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.327186Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("f83bed25-2e85-4c08-88d3-f9ab00f1d153"), "name": String("allow-icmp"), "time_created": String("2026-03-03T18:57:10.327195Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.327195Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")}]) node_id = 16 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
75392026-03-03T18:57:10.415ZDEBGtest_metrics (SEC): saga log event new_state = N017 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
75402026-03-03T18:57:10.415ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 17 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
75412026-03-03T18:57:10.418ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75422026-03-03T18:57:10.418ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75432026-03-03T18:57:10.418ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75442026-03-03T18:57:10.418ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75452026-03-03T18:57:10.418ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75462026-03-03T18:57:10.421ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75472026-03-03T18:57:10.421ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75482026-03-03T18:57:10.421ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75492026-03-03T18:57:10.421ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75502026-03-03T18:57:10.424ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75512026-03-03T18:57:10.424ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75522026-03-03T18:57:10.424ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75532026-03-03T18:57:10.424ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75542026-03-03T18:57:10.430ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75552026-03-03T18:57:10.434ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75562026-03-03T18:57:10.435ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75572026-03-03T18:57:10.435ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75582026-03-03T18:57:10.435ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75592026-03-03T18:57:10.437ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75602026-03-03T18:57:10.437ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75612026-03-03T18:57:10.437ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75622026-03-03T18:57:10.444ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75632026-03-03T18:57:10.444ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75642026-03-03T18:57:10.444ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75652026-03-03T18:57:10.471ZWARNtest_metrics (SagaExecutor): Default ip pool lookup failed: Invalid Request: Multiple default unicast IP pools exist with different IP versions. Please specify ip_version (v4 or v6) or provide an explicit pool.. Default gateway has no ip pool association authenticated = true saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75662026-03-03T18:57:10.472ZDEBGtest_metrics (SEC): saga log event new_state = N017 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
75672026-03-03T18:57:10.472ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("55ae9f25-759e-470b-865c-709fb5391660"), "lookup_type": Object {"ById": String("55ae9f25-759e-470b-865c-709fb5391660")}, "parent": Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}) node_id = 17 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
75682026-03-03T18:57:10.474ZDEBGtest_metrics (SEC): saga log event new_state = N018 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
75692026-03-03T18:57:10.474ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 18 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
75702026-03-03T18:57:10.477ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75712026-03-03T18:57:10.477ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75722026-03-03T18:57:10.477ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75732026-03-03T18:57:10.478ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75742026-03-03T18:57:10.478ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75752026-03-03T18:57:10.479ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75762026-03-03T18:57:10.480ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75772026-03-03T18:57:10.480ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75782026-03-03T18:57:10.481ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75792026-03-03T18:57:10.482ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75802026-03-03T18:57:10.482ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75812026-03-03T18:57:10.482ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75822026-03-03T18:57:10.482ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75832026-03-03T18:57:10.483ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75842026-03-03T18:57:10.485ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75852026-03-03T18:57:10.485ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75862026-03-03T18:57:10.485ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75872026-03-03T18:57:10.485ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75882026-03-03T18:57:10.487ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75892026-03-03T18:57:10.487ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75902026-03-03T18:57:10.487ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75912026-03-03T18:57:10.487ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75922026-03-03T18:57:10.489ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75932026-03-03T18:57:10.495ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75942026-03-03T18:57:10.495ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75952026-03-03T18:57:10.495ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75962026-03-03T18:57:10.495ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75972026-03-03T18:57:10.495ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75982026-03-03T18:57:10.495ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
75992026-03-03T18:57:10.495ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
76002026-03-03T18:57:10.495ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
76012026-03-03T18:57:10.501ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76022026-03-03T18:57:10.501ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76032026-03-03T18:57:10.501ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76042026-03-03T18:57:10.501ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76052026-03-03T18:57:10.503ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76062026-03-03T18:57:10.503ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76072026-03-03T18:57:10.503ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76082026-03-03T18:57:10.504ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76092026-03-03T18:57:10.505ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76102026-03-03T18:57:10.516ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76112026-03-03T18:57:10.516ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76122026-03-03T18:57:10.516ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76132026-03-03T18:57:10.516ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76142026-03-03T18:57:10.521ZDEBGtest_metrics (nexus): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
76152026-03-03T18:57:10.521ZDEBGtest_metrics (nexus): resolved firewall rules for sled agents sled_agent_rules = []
76162026-03-03T18:57:10.521ZDEBGtest_metrics (nexus): resolved 0 rules for sleds
76172026-03-03T18:57:10.530ZDEBGtest_metrics (nexus): resolved sleds for vpc default vpc_to_sled = []
76182026-03-03T18:57:10.530ZDEBGtest_metrics (nexus): sending firewall rules to sled agents
76192026-03-03T18:57:10.530ZINFOtest_metrics (nexus): updated firewall rules on 0 sleds
76202026-03-03T18:57:10.530ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76212026-03-03T18:57:10.530ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76222026-03-03T18:57:10.531ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76232026-03-03T18:57:10.534ZDEBGtest_metrics (SEC): saga log event new_state = N018 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
76242026-03-03T18:57:10.534ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
76252026-03-03T18:57:10.540ZDEBGtest_metrics (SEC): saga log event new_state = N019 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
76262026-03-03T18:57:10.540ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 19 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
76272026-03-03T18:57:10.541ZDEBGtest_metrics (SEC): saga log event new_state = N019 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
76282026-03-03T18:57:10.541ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
76292026-03-03T18:57:10.543ZDEBGtest_metrics (SEC): saga log event new_state = N021 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
76302026-03-03T18:57:10.543ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 21 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
76312026-03-03T18:57:10.544ZDEBGtest_metrics (SEC): saga log event new_state = N021 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
76322026-03-03T18:57:10.544ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 21 saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
76332026-03-03T18:57:10.546ZINFOtest_metrics (SEC): update for saga cached state new_state = Done saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb sec_id = 913233fe-92a8-4635-9572-183f495429c4
76342026-03-03T18:57:10.546ZINFOtest_metrics (SecStore): updating state new_state = done saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
76352026-03-03T18:57:10.597ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
76362026-03-03T18:57:10.597ZDEBGtest_metrics (results-sink-cluster): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
76372026-03-03T18:57:10.602ZINFOtest_metrics (SEC): saga finished result = success saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
76382026-03-03T18:57:10.602ZINFOtest_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb
76392026-03-03T18:57:10.602ZINFOtest_metrics (SagaExecutor): saga finished saga_id = 8ff5fc26-5b89-4b96-8829-38644ecb3fbb saga_name = project-create saga_result = SagaResult { saga_id: 8ff5fc26-5b89-4b96-8829-38644ecb3fbb, saga_log: SagaLog { saga_id: 8ff5fc26-5b89-4b96-8829-38644ecb3fbb, unwinding: false, events: [N020 started, N020 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N016 started, N016 succeeded, N017 started, N017 succeeded, N018 started, N018 succeeded, N019 started, N019 succeeded, N021 started, N021 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "name": String("p-1"), "time_created": String("2026-03-03T18:57:10.083562Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.083562Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd10:6312:e1c::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")), 4: Succeeded(String("602a71f8-025d-4629-ad7c-2ab5eb222ba4")), 5: Succeeded(String("dcfb83ae-ca0c-4c22-bafd-09d967ce474a")), 6: Succeeded(String("13824ae5-30f5-4cd4-bde2-548bc30fcc1f")), 7: Succeeded(String("09a3f6c2-0a40-4d38-a2a3-75ec22430161")), 8: Succeeded(String("954cc302-beec-4b31-9846-5142d8600ee1")), 9: Succeeded(String("55ae9f25-759e-470b-865c-709fb5391660")), 10: Succeeded(Array [Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "name": String("default"), "time_created": String("2026-03-03T18:57:10.135688Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.135688Z")}, "ipv6_prefix": String("fd10:6312:e1c::/48"), "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "subnet_gen": Number(1), "system_router_id": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4"), "vni": Number(5991081)}]), 11: Succeeded(Object {"key": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4"), "lookup_type": Object {"ById": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4")}, "parent": Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Array [Object {"key": String("954cc302-beec-4b31-9846-5142d8600ee1"), "lookup_type": Object {"ById": String("954cc302-beec-4b31-9846-5142d8600ee1")}, "parent": Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("954cc302-beec-4b31-9846-5142d8600ee1"), "name": String("default"), "time_created": String("2026-03-03T18:57:10.234301Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.234301Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd10:6312:e1c::/64"), "rcgen": Number(1), "vpc_id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")}]), 15: Succeeded(Object {"key": String("09a3f6c2-0a40-4d38-a2a3-75ec22430161"), "lookup_type": Object {"ById": String("954cc302-beec-4b31-9846-5142d8600ee1")}, "parent": Object {"key": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4"), "lookup_type": Object {"ById": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4")}, "parent": Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}), 16: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("1ea6046c-15a0-4fcd-b11f-4551813ccfc6"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T18:57:10.327162Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.327162Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("807f3432-8d83-4255-a58b-55e2dbe55d8f"), "name": String("allow-ssh"), "time_created": String("2026-03-03T18:57:10.327186Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.327186Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("f83bed25-2e85-4c08-88d3-f9ab00f1d153"), "name": String("allow-icmp"), "time_created": String("2026-03-03T18:57:10.327195Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.327195Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")}]), 17: Succeeded(Object {"key": String("55ae9f25-759e-470b-865c-709fb5391660"), "lookup_type": Object {"ById": String("55ae9f25-759e-470b-865c-709fb5391660")}, "parent": Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}), 18: Succeeded(Null), 19: Succeeded(Null), 20: Succeeded(Null), 21: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_internet_gateway_id": String("55ae9f25-759e-470b-865c-709fb5391660"), "default_subnet_id": String("954cc302-beec-4b31-9846-5142d8600ee1"), "default_v4_route_id": String("dcfb83ae-ca0c-4c22-bafd-09d967ce474a"), "default_v6_route_id": String("13824ae5-30f5-4cd4-bde2-548bc30fcc1f"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("1ea6046c-15a0-4fcd-b11f-4551813ccfc6"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T18:57:10.327162Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.327162Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("807f3432-8d83-4255-a58b-55e2dbe55d8f"), "name": String("allow-ssh"), "time_created": String("2026-03-03T18:57:10.327186Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.327186Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("f83bed25-2e85-4c08-88d3-f9ab00f1d153"), "name": String("allow-icmp"), "time_created": String("2026-03-03T18:57:10.327195Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.327195Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")}], "gateway": Object {"key": String("55ae9f25-759e-470b-865c-709fb5391660"), "lookup_type": Object {"ById": String("55ae9f25-759e-470b-865c-709fb5391660")}, "parent": Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, "no_result": Null, "project": Array [Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "name": String("p-1"), "time_created": String("2026-03-03T18:57:10.083562Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.083562Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}], "route": Object {"key": String("09a3f6c2-0a40-4d38-a2a3-75ec22430161"), "lookup_type": Object {"ById": String("954cc302-beec-4b31-9846-5142d8600ee1")}, "parent": Object {"key": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4"), "lookup_type": Object {"ById": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4")}, "parent": Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}, "route4": Null, "route6": Null, "router": Object {"key": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4"), "lookup_type": Object {"ById": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4")}, "parent": Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("954cc302-beec-4b31-9846-5142d8600ee1"), "lookup_type": Object {"ById": String("954cc302-beec-4b31-9846-5142d8600ee1")}, "parent": Object {"key": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("954cc302-beec-4b31-9846-5142d8600ee1"), "name": String("default"), "time_created": String("2026-03-03T18:57:10.234301Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:10.234301Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd10:6312:e1c::/64"), "rcgen": Number(1), "vpc_id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")}], "subnet_route_id": String("09a3f6c2-0a40-4d38-a2a3-75ec22430161"), "system_router_id": String("602a71f8-025d-4629-ad7c-2ab5eb222ba4"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd10:6312:e1c::/48"), "name": String("default")}}, "vpc_id": String("d828fef3-ec51-44c7-b4a4-a37c1176c89a")} }) }
76402026-03-03T18:57:10.603ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76412026-03-03T18:57:10.603ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76422026-03-03T18:57:10.603ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76432026-03-03T18:57:10.603ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76442026-03-03T18:57:10.603ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76452026-03-03T18:57:10.608ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76462026-03-03T18:57:10.608ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76472026-03-03T18:57:10.608ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76482026-03-03T18:57:10.608ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76492026-03-03T18:57:10.608ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76502026-03-03T18:57:10.614ZINFOtest_metrics (dropshot_external): request completed latency_us = 624914 local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = 73ffd96b-000b-4be7-8b7c-eaedad45a8d2 response_code = 201 uri = /v1/projects
76512026-03-03T18:57:10.614ZINFOtest_metrics (external client test context): client received response status = 201
76522026-03-03T18:57:10.614ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
76532026-03-03T18:57:10.615ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
76542026-03-03T18:57:10.615ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
76552026-03-03T18:57:10.615ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
76562026-03-03T18:57:10.615ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
76572026-03-03T18:57:10.615ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
76582026-03-03T18:57:10.615ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
76592026-03-03T18:57:10.615ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
76602026-03-03T18:57:10.615ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493 version = 2026021900.0.0
76612026-03-03T18:57:10.616ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 13680a4b-a1b7-47ff-a074-0ca5db0aabab uri = /913233fe-92a8-4635-9572-183f495429c4
76622026-03-03T18:57:10.616ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
76632026-03-03T18:57:10.616ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
76642026-03-03T18:57:10.616ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
76652026-03-03T18:57:10.616ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
76662026-03-03T18:57:10.617ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
76672026-03-03T18:57:10.625ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 9691 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 13680a4b-a1b7-47ff-a074-0ca5db0aabab response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
76682026-03-03T18:57:10.626ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
76692026-03-03T18:57:10.637ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
76702026-03-03T18:57:10.637ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
76712026-03-03T18:57:10.637ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
76722026-03-03T18:57:10.638ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
76732026-03-03T18:57:10.638ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
76742026-03-03T18:57:10.638ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
76752026-03-03T18:57:10.638ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
76762026-03-03T18:57:10.638ZDEBGtest_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
76772026-03-03T18:57:10.638ZDEBGtest_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
76782026-03-03T18:57:10.649ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 26 sql = INSERT INTO oximeter.fields_string FORMAT Native
76792026-03-03T18:57:10.661ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
76802026-03-03T18:57:10.661ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
76812026-03-03T18:57:10.661ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
76822026-03-03T18:57:10.661ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
76832026-03-03T18:57:10.661ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
76842026-03-03T18:57:10.661ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
76852026-03-03T18:57:10.661ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
76862026-03-03T18:57:10.661ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
76872026-03-03T18:57:10.663ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 26 table_name = fields_string
76882026-03-03T18:57:10.663ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
76892026-03-03T18:57:10.664ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = fields_u16
76902026-03-03T18:57:10.664ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
76912026-03-03T18:57:10.670ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_uuid
76922026-03-03T18:57:10.670ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
76932026-03-03T18:57:10.680ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
76942026-03-03T18:57:10.680ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
76952026-03-03T18:57:10.680ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
76962026-03-03T18:57:10.681ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
76972026-03-03T18:57:10.683ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = measurements_histogramu64
76982026-03-03T18:57:10.683ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 4 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
76992026-03-03T18:57:10.685ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
77002026-03-03T18:57:10.687ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
77012026-03-03T18:57:10.687ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
77022026-03-03T18:57:10.687ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
77032026-03-03T18:57:10.688ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
77042026-03-03T18:57:10.689ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 4 table_name = measurements_i64
77052026-03-03T18:57:10.689ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
77062026-03-03T18:57:10.689ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
77072026-03-03T18:57:10.689ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
77082026-03-03T18:57:10.690ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
77092026-03-03T18:57:10.690ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
77102026-03-03T18:57:10.690ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
77112026-03-03T18:57:10.690ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
77122026-03-03T18:57:10.690ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
77132026-03-03T18:57:10.691ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
77142026-03-03T18:57:10.692ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
77152026-03-03T18:57:10.692ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
77162026-03-03T18:57:10.693ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
77172026-03-03T18:57:10.693ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
77182026-03-03T18:57:10.693ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
77192026-03-03T18:57:10.697ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
77202026-03-03T18:57:10.705ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
77212026-03-03T18:57:10.705ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
77222026-03-03T18:57:10.705ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77232026-03-03T18:57:10.705ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77242026-03-03T18:57:10.705ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77252026-03-03T18:57:10.705ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77262026-03-03T18:57:10.705ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77272026-03-03T18:57:10.705ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77282026-03-03T18:57:10.705ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
77292026-03-03T18:57:10.705ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
77302026-03-03T18:57:10.705ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
77312026-03-03T18:57:10.705ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
77322026-03-03T18:57:10.705ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77332026-03-03T18:57:10.705ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77342026-03-03T18:57:10.705ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77352026-03-03T18:57:10.705ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77362026-03-03T18:57:10.705ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77372026-03-03T18:57:10.705ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77382026-03-03T18:57:10.705ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77392026-03-03T18:57:10.705ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77402026-03-03T18:57:10.705ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77412026-03-03T18:57:10.706ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77422026-03-03T18:57:10.706ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77432026-03-03T18:57:10.706ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77442026-03-03T18:57:10.710ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77452026-03-03T18:57:10.710ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77462026-03-03T18:57:10.710ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77472026-03-03T18:57:10.710ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77482026-03-03T18:57:10.710ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77492026-03-03T18:57:10.712ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77502026-03-03T18:57:10.712ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77512026-03-03T18:57:10.712ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77522026-03-03T18:57:10.712ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77532026-03-03T18:57:10.714ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77542026-03-03T18:57:10.714ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77552026-03-03T18:57:10.714ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77562026-03-03T18:57:10.715ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77572026-03-03T18:57:10.720ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77582026-03-03T18:57:10.747ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77592026-03-03T18:57:10.747ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77602026-03-03T18:57:10.747ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77612026-03-03T18:57:10.747ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77622026-03-03T18:57:10.747ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77632026-03-03T18:57:10.747ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77642026-03-03T18:57:10.750ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77652026-03-03T18:57:10.750ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77662026-03-03T18:57:10.750ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77672026-03-03T18:57:10.750ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77682026-03-03T18:57:10.759ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77692026-03-03T18:57:10.762ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77702026-03-03T18:57:10.769ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '47174ca8-7062-4b5d-a8de-3ad573d1f493') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
77712026-03-03T18:57:10.772ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (11045350386984208624) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:10.614765002' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
77722026-03-03T18:57:10.774ZINFOtest_metrics (dropshot_external): request completed latency_us = 158907 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 39a9fd3a-0ab1-4641-bde9-516b9a171670 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.614765002Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77732026-03-03T18:57:10.775ZINFOtest_metrics (external client test context): client received response status = 200
77742026-03-03T18:57:10.775ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77752026-03-03T18:57:10.775ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
77762026-03-03T18:57:10.775ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
77772026-03-03T18:57:10.775ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
77782026-03-03T18:57:10.775ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
77792026-03-03T18:57:10.775ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
77802026-03-03T18:57:10.775ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
77812026-03-03T18:57:10.775ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77822026-03-03T18:57:10.775ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493 version = 2026021900.0.0
77832026-03-03T18:57:10.775ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 43e45b43-e79e-40be-bd12-d14177a40aa4 uri = /913233fe-92a8-4635-9572-183f495429c4
77842026-03-03T18:57:10.776ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77852026-03-03T18:57:10.776ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
77862026-03-03T18:57:10.776ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
77872026-03-03T18:57:10.776ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
77882026-03-03T18:57:10.776ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
77892026-03-03T18:57:10.784ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 8290 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 43e45b43-e79e-40be-bd12-d14177a40aa4 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
77902026-03-03T18:57:10.784ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
77912026-03-03T18:57:10.794ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
77922026-03-03T18:57:10.794ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
77932026-03-03T18:57:10.794ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
77942026-03-03T18:57:10.794ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
77952026-03-03T18:57:10.794ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
77962026-03-03T18:57:10.794ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
77972026-03-03T18:57:10.794ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
77982026-03-03T18:57:10.794ZDEBGtest_metrics (results-sink): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
77992026-03-03T18:57:10.794ZDEBGtest_metrics (clickhouse-client): unrolling 12 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
78002026-03-03T18:57:10.799ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 24 sql = INSERT INTO oximeter.fields_string FORMAT Native
78012026-03-03T18:57:10.800ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
78022026-03-03T18:57:10.800ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
78032026-03-03T18:57:10.801ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
78042026-03-03T18:57:10.825ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
78052026-03-03T18:57:10.825ZDEBGtest_metrics (results-sink-cluster): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
78062026-03-03T18:57:10.825ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 24 table_name = fields_string
78072026-03-03T18:57:10.825ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
78082026-03-03T18:57:10.825ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
78092026-03-03T18:57:10.825ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
78102026-03-03T18:57:10.825ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
78112026-03-03T18:57:10.825ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
78122026-03-03T18:57:10.825ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
78132026-03-03T18:57:10.827ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = fields_u16
78142026-03-03T18:57:10.827ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
78152026-03-03T18:57:10.828ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
78162026-03-03T18:57:10.828ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
78172026-03-03T18:57:10.828ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
78182026-03-03T18:57:10.829ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
78192026-03-03T18:57:10.829ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = fields_uuid
78202026-03-03T18:57:10.829ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
78212026-03-03T18:57:10.832ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
78222026-03-03T18:57:10.842ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
78232026-03-03T18:57:10.842ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
78242026-03-03T18:57:10.842ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
78252026-03-03T18:57:10.843ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
78262026-03-03T18:57:10.844ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = measurements_histogramu64
78272026-03-03T18:57:10.844ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
78282026-03-03T18:57:10.844ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
78292026-03-03T18:57:10.844ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
78302026-03-03T18:57:10.845ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
78312026-03-03T18:57:10.846ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
78322026-03-03T18:57:10.846ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
78332026-03-03T18:57:10.846ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
78342026-03-03T18:57:10.846ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
78352026-03-03T18:57:10.846ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
78362026-03-03T18:57:10.853ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
78372026-03-03T18:57:10.853ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
78382026-03-03T18:57:10.853ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
78392026-03-03T18:57:10.853ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
78402026-03-03T18:57:10.853ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
78412026-03-03T18:57:10.853ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
78422026-03-03T18:57:10.853ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
78432026-03-03T18:57:10.853ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
78442026-03-03T18:57:10.853ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78452026-03-03T18:57:10.853ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78462026-03-03T18:57:10.853ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78472026-03-03T18:57:10.853ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78482026-03-03T18:57:10.853ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78492026-03-03T18:57:10.853ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78502026-03-03T18:57:10.855ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78512026-03-03T18:57:10.855ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78522026-03-03T18:57:10.855ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78532026-03-03T18:57:10.855ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78542026-03-03T18:57:10.856ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
78552026-03-03T18:57:10.856ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
78562026-03-03T18:57:10.856ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78572026-03-03T18:57:10.860ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78582026-03-03T18:57:10.860ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78592026-03-03T18:57:10.860ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78602026-03-03T18:57:10.860ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78612026-03-03T18:57:10.864ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78622026-03-03T18:57:10.864ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78632026-03-03T18:57:10.865ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78642026-03-03T18:57:10.867ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78652026-03-03T18:57:10.867ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78662026-03-03T18:57:10.867ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78672026-03-03T18:57:10.867ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78682026-03-03T18:57:10.867ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78692026-03-03T18:57:10.869ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78702026-03-03T18:57:10.869ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78712026-03-03T18:57:10.869ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78722026-03-03T18:57:10.869ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78732026-03-03T18:57:10.871ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78742026-03-03T18:57:10.871ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78752026-03-03T18:57:10.871ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78762026-03-03T18:57:10.871ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78772026-03-03T18:57:10.881ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78782026-03-03T18:57:10.893ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78792026-03-03T18:57:10.893ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78802026-03-03T18:57:10.893ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78812026-03-03T18:57:10.894ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78822026-03-03T18:57:10.894ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78832026-03-03T18:57:10.895ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78842026-03-03T18:57:10.899ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78852026-03-03T18:57:10.899ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78862026-03-03T18:57:10.899ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78872026-03-03T18:57:10.904ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78882026-03-03T18:57:10.914ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78892026-03-03T18:57:10.916ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78902026-03-03T18:57:10.921ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '47174ca8-7062-4b5d-a8de-3ad573d1f493') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
78912026-03-03T18:57:10.921ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (8721817720517468360) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:10.775221568' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
78922026-03-03T18:57:10.928ZINFOtest_metrics (dropshot_external): request completed latency_us = 152635 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 4d01f106-911b-4301-9726-9f54b0ac78cc response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.775221568Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78932026-03-03T18:57:10.928ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
78942026-03-03T18:57:10.928ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
78952026-03-03T18:57:10.928ZINFOtest_metrics (external client test context): client received response status = 200
78962026-03-03T18:57:10.929ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
78972026-03-03T18:57:10.929ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
78982026-03-03T18:57:10.929ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
78992026-03-03T18:57:10.929ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
79002026-03-03T18:57:10.929ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
79012026-03-03T18:57:10.929ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
79022026-03-03T18:57:10.929ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
79032026-03-03T18:57:10.929ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79042026-03-03T18:57:10.929ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493 version = 2026021900.0.0
79052026-03-03T18:57:10.929ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 6fa1aeee-8f17-44e5-8ec5-cb58b31ef6f2 uri = /913233fe-92a8-4635-9572-183f495429c4
79062026-03-03T18:57:10.930ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79072026-03-03T18:57:10.930ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79082026-03-03T18:57:10.930ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
79092026-03-03T18:57:10.930ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
79102026-03-03T18:57:10.930ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
79112026-03-03T18:57:10.940ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 10773 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 6fa1aeee-8f17-44e5-8ec5-cb58b31ef6f2 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
79122026-03-03T18:57:10.943ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
79132026-03-03T18:57:10.951ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
79142026-03-03T18:57:10.951ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
79152026-03-03T18:57:10.951ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
79162026-03-03T18:57:10.951ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
79172026-03-03T18:57:10.951ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
79182026-03-03T18:57:10.951ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
79192026-03-03T18:57:10.951ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
79202026-03-03T18:57:10.951ZDEBGtest_metrics (results-sink): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
79212026-03-03T18:57:10.951ZDEBGtest_metrics (clickhouse-client): unrolling 12 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
79222026-03-03T18:57:10.972ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 24 sql = INSERT INTO oximeter.fields_string FORMAT Native
79232026-03-03T18:57:10.974ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
79242026-03-03T18:57:10.974ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
79252026-03-03T18:57:10.974ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
79262026-03-03T18:57:10.975ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 24 table_name = fields_string
79272026-03-03T18:57:10.976ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
79282026-03-03T18:57:10.979ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = fields_u16
79292026-03-03T18:57:10.979ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
79302026-03-03T18:57:10.979ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
79312026-03-03T18:57:10.979ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
79322026-03-03T18:57:10.979ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
79332026-03-03T18:57:10.979ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
79342026-03-03T18:57:10.980ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
79352026-03-03T18:57:10.981ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = fields_uuid
79362026-03-03T18:57:10.981ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
79372026-03-03T18:57:10.981ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
79382026-03-03T18:57:10.981ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
79392026-03-03T18:57:10.981ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
79402026-03-03T18:57:10.982ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
79412026-03-03T18:57:10.983ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = measurements_histogramu64
79422026-03-03T18:57:10.983ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
79432026-03-03T18:57:10.984ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
79442026-03-03T18:57:10.984ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
79452026-03-03T18:57:10.984ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
79462026-03-03T18:57:10.986ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
79472026-03-03T18:57:10.988ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
79482026-03-03T18:57:10.988ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
79492026-03-03T18:57:10.988ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
79502026-03-03T18:57:10.989ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
79512026-03-03T18:57:10.997ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
79522026-03-03T18:57:10.997ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
79532026-03-03T18:57:10.998ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
79542026-03-03T18:57:10.998ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
79552026-03-03T18:57:10.998ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
79562026-03-03T18:57:10.998ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
79572026-03-03T18:57:10.998ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
79582026-03-03T18:57:11.004ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
79592026-03-03T18:57:11.004ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
79602026-03-03T18:57:11.005ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
79612026-03-03T18:57:11.005ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
79622026-03-03T18:57:11.005ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
79632026-03-03T18:57:11.006ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
79642026-03-03T18:57:11.013ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
79652026-03-03T18:57:11.015ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
79662026-03-03T18:57:11.015ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79672026-03-03T18:57:11.015ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79682026-03-03T18:57:11.015ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79692026-03-03T18:57:11.015ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79702026-03-03T18:57:11.015ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79712026-03-03T18:57:11.016ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79722026-03-03T18:57:11.021ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79732026-03-03T18:57:11.021ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79742026-03-03T18:57:11.021ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79752026-03-03T18:57:11.022ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79762026-03-03T18:57:11.035ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
79772026-03-03T18:57:11.035ZDEBGtest_metrics (results-sink-cluster): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
79782026-03-03T18:57:11.035ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79792026-03-03T18:57:11.035ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79802026-03-03T18:57:11.035ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79812026-03-03T18:57:11.035ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79822026-03-03T18:57:11.035ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79832026-03-03T18:57:11.036ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 86 9c 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:65003 req_id = 866c31b8-34df-46ca-9cb9-7ef6ebc9c964
79842026-03-03T18:57:11.036ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 34460,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:65003 req_id = 866c31b8-34df-46ca-9cb9-7ef6ebc9c964
79852026-03-03T18:57:11.036ZDEBGtest_metrics (store): query key key = _mgs._tcp
79862026-03-03T18:57:11.036ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
79872026-03-03T18:57:11.036ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:65003 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42517, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 866c31b8-34df-46ca-9cb9-7ef6ebc9c964
79882026-03-03T18:57:11.036ZTRACtest_metrics (dns): buffer buffer = Length: 74 (0x4a) bytes\n0000: 2b bb 01 00 00 01 00 00 00 00 00 01 0b 5f 72 65 +............_re\n0010: 70 6f 2d 64 65 70 6f 74 04 5f 74 63 70 0d 63 6f po-depot._tcp.co\n0020: 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 ntrol-plane.oxid\n0030: 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 e.internal..!...\n0040: 00 29 04 d0 00 00 00 00 00 00 .)........ kind = dns peer_addr = [::1]:64304 req_id = 63510527-c5fe-4240-8cc0-3d322feca9e7
79892026-03-03T18:57:11.036ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 11195,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_repo-depot._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_repo-depot._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 11,\n 95,\n 114,\n 101,\n 112,\n 111,\n 45,\n 100,\n 101,\n 112,\n 111,\n 116,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:64304 req_id = 63510527-c5fe-4240-8cc0-3d322feca9e7
79902026-03-03T18:57:11.036ZDEBGtest_metrics (store): query key key = _repo-depot._tcp
79912026-03-03T18:57:11.036ZDEBGtest_metrics (store): query key key = b6d65341-167c-41df-9b5c-41cded99c229.sled
79922026-03-03T18:57:11.036ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:64304 query = LowerQuery { name: LowerName(Name("_repo-depot._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_repo-depot._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_repo-depot._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42957, target: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal") }) }] req_id = 63510527-c5fe-4240-8cc0-3d322feca9e7
79932026-03-03T18:57:11.037ZTRACtest_metrics (dns): buffer buffer = Length: 79 (0x4f) bytes\n0000: f8 74 01 00 00 01 00 00 00 00 00 01 10 5f 63 72 .t..........._cr\n0010: 75 63 69 62 6c 65 2d 70 61 6e 74 72 79 04 5f 74 ucible-pantry._t\n0020: 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 cp.control-plane\n0030: 05 6f 78 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 .oxide.internal.\n0040: 00 21 00 01 00 00 29 04 d0 00 00 00 00 00 00 .!....)........ kind = dns peer_addr = [::1]:64206 req_id = 65740f38-1819-4875-a88b-196dbba103d3
79942026-03-03T18:57:11.037ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 63604,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 16,\n 95,\n 99,\n 114,\n 117,\n 99,\n 105,\n 98,\n 108,\n 101,\n 45,\n 112,\n 97,\n 110,\n 116,\n 114,\n 121,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:64206 req_id = 65740f38-1819-4875-a88b-196dbba103d3
79952026-03-03T18:57:11.037ZDEBGtest_metrics (store): query key key = _crucible-pantry._tcp
79962026-03-03T18:57:11.037ZDEBGtest_metrics (store): query key key = 301cc00d-744b-4e0c-83c6-e8f8b1c76505.host
79972026-03-03T18:57:11.037ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("301cc00d-744b-4e0c-83c6-e8f8b1c76505.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:64206 query = LowerQuery { name: LowerName(Name("_crucible-pantry._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_crucible-pantry._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32837, target: Name("301cc00d-744b-4e0c-83c6-e8f8b1c76505.host.control-plane.oxide.internal") }) }] req_id = 65740f38-1819-4875-a88b-196dbba103d3
79982026-03-03T18:57:11.037ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
79992026-03-03T18:57:11.037ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80002026-03-03T18:57:11.043ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80012026-03-03T18:57:11.045ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 34 db 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e 4...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:56287 req_id = c3f40bd6-1bce-43b9-b2f0-4e6e1b8861ee
80022026-03-03T18:57:11.045ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 13531,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:56287 req_id = c3f40bd6-1bce-43b9-b2f0-4e6e1b8861ee
80032026-03-03T18:57:11.045ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
80042026-03-03T18:57:11.045ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:56287 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = c3f40bd6-1bce-43b9-b2f0-4e6e1b8861ee
80052026-03-03T18:57:11.045ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 61 c0 01 00 00 01 00 00 00 00 00 01 24 62 36 64 a...........$b6d\n0010: 36 35 33 34 31 2d 31 36 37 63 2d 34 31 64 66 2d 65341-167c-41df-\n0020: 39 62 35 63 2d 34 31 63 64 65 64 39 39 63 32 32 9b5c-41cded99c22\n0030: 39 04 73 6c 65 64 0d 63 6f 6e 74 72 6f 6c 2d 70 9.sled.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:60706 req_id = 301f3793-17ee-4bff-aa50-b6a9ff6a73f9
80062026-03-03T18:57:11.045ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 25024,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 115,\n 108,\n 101,\n 100,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:60706 req_id = 301f3793-17ee-4bff-aa50-b6a9ff6a73f9
80072026-03-03T18:57:11.045ZDEBGtest_metrics (store): query key key = b6d65341-167c-41df-9b5c-41cded99c229.sled
80082026-03-03T18:57:11.045ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:60706 query = LowerQuery { name: LowerName(Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal.")), original: Query { name: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 301f3793-17ee-4bff-aa50-b6a9ff6a73f9
80092026-03-03T18:57:11.045ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: dc 39 01 00 00 01 00 00 00 00 00 01 24 33 30 31 .9..........$301\n0010: 63 63 30 30 64 2d 37 34 34 62 2d 34 65 30 63 2d cc00d-744b-4e0c-\n0020: 38 33 63 36 2d 65 38 66 38 62 31 63 37 36 35 30 83c6-e8f8b1c7650\n0030: 35 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 5.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:62117 req_id = 3ff8929f-f967-4286-a169-d1b989ea7001
80102026-03-03T18:57:11.045ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 56377,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("301cc00d-744b-4e0c-83c6-e8f8b1c76505.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("301cc00d-744b-4e0c-83c6-e8f8b1c76505.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 51,\n 48,\n 49,\n 99,\n 99,\n 48,\n 48,\n 100,\n 45,\n 55,\n 52,\n 52,\n 98,\n 45,\n 52,\n 101,\n 48,\n 99,\n 45,\n 56,\n 51,\n 99,\n 54,\n 45,\n 101,\n 56,\n 102,\n 56,\n 98,\n 49,\n 99,\n 55,\n 54,\n 53,\n 48,\n 53,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:62117 req_id = 3ff8929f-f967-4286-a169-d1b989ea7001
80112026-03-03T18:57:11.045ZDEBGtest_metrics (store): query key key = 301cc00d-744b-4e0c-83c6-e8f8b1c76505.host
80122026-03-03T18:57:11.045ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:62117 query = LowerQuery { name: LowerName(Name("301cc00d-744b-4e0c-83c6-e8f8b1c76505.host.control-plane.oxide.internal.")), original: Query { name: Name("301cc00d-744b-4e0c-83c6-e8f8b1c76505.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("301cc00d-744b-4e0c-83c6-e8f8b1c76505.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 3ff8929f-f967-4286-a169-d1b989ea7001
80132026-03-03T18:57:11.051ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80142026-03-03T18:57:11.051ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80152026-03-03T18:57:11.051ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80162026-03-03T18:57:11.051ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80172026-03-03T18:57:11.051ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80182026-03-03T18:57:11.088ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:32837 remote_addr = [::1]:51762 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
80192026-03-03T18:57:11.088ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
80202026-03-03T18:57:11.089ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:32837 method = GET remote_addr = [::1]:51762 req_id = 4976e159-ee07-4d08-ba7a-74c226a8a7a5 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80212026-03-03T18:57:11.089ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 395 local_addr = [::1]:32837 method = GET remote_addr = [::1]:51762 req_id = 4976e159-ee07-4d08-ba7a-74c226a8a7a5 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80222026-03-03T18:57:11.169ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80232026-03-03T18:57:11.169ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80242026-03-03T18:57:11.169ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80252026-03-03T18:57:11.170ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80262026-03-03T18:57:11.228ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:32837 remote_addr = [::1]:51764 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
80272026-03-03T18:57:11.228ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:32837 remote_addr = [::1]:51766 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
80282026-03-03T18:57:11.228ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:32837 remote_addr = [::1]:51768 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
80292026-03-03T18:57:11.228ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:32837 remote_addr = [::1]:51770 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
80302026-03-03T18:57:11.228ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:32837 remote_addr = [::1]:51772 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
80312026-03-03T18:57:11.228ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:32837 remote_addr = [::1]:51774 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
80322026-03-03T18:57:11.228ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:32837 remote_addr = [::1]:51776 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
80332026-03-03T18:57:11.228ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
80342026-03-03T18:57:11.228ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
80352026-03-03T18:57:11.228ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
80362026-03-03T18:57:11.228ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
80372026-03-03T18:57:11.229ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:32837 method = GET remote_addr = [::1]:51764 req_id = 594aa7d4-2ac0-4253-a75c-e9d4a8d78859 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80382026-03-03T18:57:11.229ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:32837 method = GET remote_addr = [::1]:51766 req_id = 6f74615b-c94f-4736-a857-a347a34ab09e sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80392026-03-03T18:57:11.229ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:32837 method = GET remote_addr = [::1]:51768 req_id = a3531220-6ae4-45a7-bb6b-4528c1d50b9f sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80402026-03-03T18:57:11.229ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:32837 method = GET remote_addr = [::1]:51770 req_id = 300bafc6-d4ce-499b-a300-b490e8cff2ff sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80412026-03-03T18:57:11.229ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:32837 method = GET remote_addr = [::1]:51772 req_id = 8f91ff13-a891-4ef5-ac7b-3426201c105f sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80422026-03-03T18:57:11.229ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:32837 method = GET remote_addr = [::1]:51774 req_id = 4815f1cf-05d4-4533-b348-36eee25281b5 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80432026-03-03T18:57:11.229ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:32837 method = GET remote_addr = [::1]:51776 req_id = 8c171ce9-a624-408a-be35-89e68669c9c7 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80442026-03-03T18:57:11.234ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 1963 local_addr = [::1]:32837 method = GET remote_addr = [::1]:51764 req_id = 594aa7d4-2ac0-4253-a75c-e9d4a8d78859 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80452026-03-03T18:57:11.234ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 1943 local_addr = [::1]:32837 method = GET remote_addr = [::1]:51766 req_id = 6f74615b-c94f-4736-a857-a347a34ab09e response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80462026-03-03T18:57:11.234ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 1931 local_addr = [::1]:32837 method = GET remote_addr = [::1]:51768 req_id = a3531220-6ae4-45a7-bb6b-4528c1d50b9f response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80472026-03-03T18:57:11.234ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 1920 local_addr = [::1]:32837 method = GET remote_addr = [::1]:51770 req_id = 300bafc6-d4ce-499b-a300-b490e8cff2ff response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80482026-03-03T18:57:11.234ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 1909 local_addr = [::1]:32837 method = GET remote_addr = [::1]:51772 req_id = 8f91ff13-a891-4ef5-ac7b-3426201c105f response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80492026-03-03T18:57:11.234ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 1900 local_addr = [::1]:32837 method = GET remote_addr = [::1]:51774 req_id = 4815f1cf-05d4-4533-b348-36eee25281b5 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80502026-03-03T18:57:11.234ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 1886 local_addr = [::1]:32837 method = GET remote_addr = [::1]:51776 req_id = 8c171ce9-a624-408a-be35-89e68669c9c7 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
80512026-03-03T18:57:11.234ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80522026-03-03T18:57:11.234ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80532026-03-03T18:57:11.234ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80542026-03-03T18:57:11.234ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80552026-03-03T18:57:11.234ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
80562026-03-03T18:57:11.234ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
80572026-03-03T18:57:11.234ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
80582026-03-03T18:57:11.234ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
80592026-03-03T18:57:11.241ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80602026-03-03T18:57:11.243ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80612026-03-03T18:57:11.243ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80622026-03-03T18:57:11.244ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80632026-03-03T18:57:11.244ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80642026-03-03T18:57:11.244ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80652026-03-03T18:57:11.244ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80662026-03-03T18:57:11.248ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80672026-03-03T18:57:11.248ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80682026-03-03T18:57:11.248ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80692026-03-03T18:57:11.248ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80702026-03-03T18:57:11.253ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80712026-03-03T18:57:11.253ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80722026-03-03T18:57:11.254ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '47174ca8-7062-4b5d-a8de-3ad573d1f493') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
80732026-03-03T18:57:11.257ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (9383865214650852877) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:10.929143365' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
80742026-03-03T18:57:11.259ZINFOtest_metrics (dropshot_external): request completed latency_us = 329285 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = e1c28dce-4611-400b-83f5-e002a7449360 response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:10.929143365Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
80752026-03-03T18:57:11.259ZINFOtest_metrics (external client test context): client received response status = 200
80762026-03-03T18:57:11.259ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:37769/v1/projects
80772026-03-03T18:57:11.259ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c uri = /v1/projects
80782026-03-03T18:57:11.259ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c uri = /v1/projects version = 2026021900.0.0
80792026-03-03T18:57:11.259ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c uri = /v1/projects
80802026-03-03T18:57:11.259ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/projects
80812026-03-03T18:57:11.259ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80822026-03-03T18:57:11.260ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80832026-03-03T18:57:11.260ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80842026-03-03T18:57:11.262ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80852026-03-03T18:57:11.264ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80862026-03-03T18:57:11.264ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80872026-03-03T18:57:11.264ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
80882026-03-03T18:57:11.264ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
80892026-03-03T18:57:11.264ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80902026-03-03T18:57:11.264ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80912026-03-03T18:57:11.264ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80922026-03-03T18:57:11.273ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
80932026-03-03T18:57:11.273ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80942026-03-03T18:57:11.273ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80952026-03-03T18:57:11.274ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80962026-03-03T18:57:11.276ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
80972026-03-03T18:57:11.278ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
80982026-03-03T18:57:11.278ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80992026-03-03T18:57:11.278ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
81002026-03-03T18:57:11.279ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
81012026-03-03T18:57:11.280ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
81022026-03-03T18:57:11.280ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
81032026-03-03T18:57:11.280ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
81042026-03-03T18:57:11.280ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
81052026-03-03T18:57:11.281ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
81062026-03-03T18:57:11.282ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
81072026-03-03T18:57:11.283ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
81082026-03-03T18:57:11.283ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
81092026-03-03T18:57:11.283ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
81102026-03-03T18:57:11.284ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
81112026-03-03T18:57:11.286ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
81122026-03-03T18:57:11.287ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c uri = /v1/projects
81132026-03-03T18:57:11.287ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81142026-03-03T18:57:11.287ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81152026-03-03T18:57:11.287ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81162026-03-03T18:57:11.287ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81172026-03-03T18:57:11.287ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81182026-03-03T18:57:11.296ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81192026-03-03T18:57:11.298ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81202026-03-03T18:57:11.298ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81212026-03-03T18:57:11.298ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81222026-03-03T18:57:11.299ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81232026-03-03T18:57:11.301ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81242026-03-03T18:57:11.301ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81252026-03-03T18:57:11.301ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81262026-03-03T18:57:11.301ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81272026-03-03T18:57:11.301ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81282026-03-03T18:57:11.308ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81292026-03-03T18:57:11.309ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81302026-03-03T18:57:11.309ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81312026-03-03T18:57:11.309ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81322026-03-03T18:57:11.315ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81332026-03-03T18:57:11.318ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
81342026-03-03T18:57:11.319ZINFOtest_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81352026-03-03T18:57:11.319ZINFOtest_metrics (SagaExecutor): preparing saga saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create
81362026-03-03T18:57:11.319ZINFOtest_metrics (SEC): saga create dag = {"end_node":21,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[14,15,null],[15,16,null],[16,17,null],[17,18,null],[2,3,null],[18,19,null],[20,0,null],[19,21,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSubnetRouteId","name":"subnet_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultInternetGatewayId","name":"default_internet_gateway_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet_route","label":"VpcCreateSubnetRoute","name":"route"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_create_gateway","label":"VpcCreateGateway","name":"gateway"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"001de000-5110-4000-8000-000000000000","lookup_type":{"ById":"001de000-5110-4000-8000-000000000000"},"parent":null},"project_create":{"description":"a pier","name":"p-2"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"project-create","start_node":20} saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
81372026-03-03T18:57:11.319ZINFOtest_metrics (SecStore): creating saga saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create
81382026-03-03T18:57:11.321ZINFOtest_metrics (SagaExecutor): starting saga saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create
81392026-03-03T18:57:11.328ZINFOtest_metrics (SEC): saga start saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
81402026-03-03T18:57:11.328ZDEBGtest_metrics (SEC): saga log event new_state = N020 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81412026-03-03T18:57:11.328ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 20 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81422026-03-03T18:57:11.330ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
81432026-03-03T18:57:11.330ZDEBGtest_metrics (results-sink-cluster): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
81442026-03-03T18:57:11.333ZDEBGtest_metrics (SEC): saga log event new_state = N020 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81452026-03-03T18:57:11.333ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 20 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81462026-03-03T18:57:11.338ZDEBGtest_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81472026-03-03T18:57:11.338ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81482026-03-03T18:57:11.346ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81492026-03-03T18:57:11.348ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81502026-03-03T18:57:11.348ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81512026-03-03T18:57:11.348ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81522026-03-03T18:57:11.348ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81532026-03-03T18:57:11.349ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81542026-03-03T18:57:11.349ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81552026-03-03T18:57:11.349ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81562026-03-03T18:57:11.350ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81572026-03-03T18:57:11.352ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81582026-03-03T18:57:11.354ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81592026-03-03T18:57:11.356ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81602026-03-03T18:57:11.356ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81612026-03-03T18:57:11.356ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
81622026-03-03T18:57:11.371ZDEBGtest_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81632026-03-03T18:57:11.371ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("0646e606-7015-43d9-9bcf-924637144f52"), "name": String("p-2"), "time_created": String("2026-03-03T18:57:11.346731Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.346731Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}]) node_id = 0 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81642026-03-03T18:57:11.374ZDEBGtest_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81652026-03-03T18:57:11.374ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81662026-03-03T18:57:11.377ZDEBGtest_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81672026-03-03T18:57:11.377ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd7f:33b4:15f5::/48"), "name": String("default")}}) node_id = 1 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81682026-03-03T18:57:11.379ZDEBGtest_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81692026-03-03T18:57:11.379ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81702026-03-03T18:57:11.380ZDEBGtest_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81712026-03-03T18:57:11.381ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81722026-03-03T18:57:11.382ZDEBGtest_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81732026-03-03T18:57:11.382ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81742026-03-03T18:57:11.383ZDEBGtest_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81752026-03-03T18:57:11.383ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")) node_id = 3 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81762026-03-03T18:57:11.386ZDEBGtest_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81772026-03-03T18:57:11.386ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81782026-03-03T18:57:11.387ZDEBGtest_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81792026-03-03T18:57:11.387ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("689688b5-13ee-4ea9-8290-d1974c9cb113")) node_id = 4 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81802026-03-03T18:57:11.389ZDEBGtest_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81812026-03-03T18:57:11.389ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81822026-03-03T18:57:11.391ZDEBGtest_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81832026-03-03T18:57:11.391ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("1c648985-a170-4460-bbf7-7464432e653d")) node_id = 5 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81842026-03-03T18:57:11.393ZDEBGtest_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81852026-03-03T18:57:11.393ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81862026-03-03T18:57:11.394ZDEBGtest_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81872026-03-03T18:57:11.395ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("9a975a39-e8b1-4ea1-adb9-d2f105758c5c")) node_id = 6 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81882026-03-03T18:57:11.395ZDEBGtest_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81892026-03-03T18:57:11.395ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81902026-03-03T18:57:11.397ZDEBGtest_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81912026-03-03T18:57:11.397ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("85fd8b62-dabf-41e5-a93a-b85751c2f0d4")) node_id = 7 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81922026-03-03T18:57:11.398ZDEBGtest_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81932026-03-03T18:57:11.398ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81942026-03-03T18:57:11.399ZDEBGtest_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81952026-03-03T18:57:11.399ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546")) node_id = 8 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81962026-03-03T18:57:11.410ZDEBGtest_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81972026-03-03T18:57:11.411ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
81982026-03-03T18:57:11.413ZDEBGtest_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81992026-03-03T18:57:11.413ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("038eb9db-7389-46a3-b7e4-b4d4720c67a5")) node_id = 9 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
82002026-03-03T18:57:11.415ZDEBGtest_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
82012026-03-03T18:57:11.416ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
82022026-03-03T18:57:11.418ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82032026-03-03T18:57:11.418ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 0646e606-7015-43d9-9bcf-924637144f52 resource_type = Project saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82042026-03-03T18:57:11.418ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82052026-03-03T18:57:11.418ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82062026-03-03T18:57:11.418ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82072026-03-03T18:57:11.420ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82082026-03-03T18:57:11.420ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82092026-03-03T18:57:11.420ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82102026-03-03T18:57:11.421ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82112026-03-03T18:57:11.422ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82122026-03-03T18:57:11.424ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82132026-03-03T18:57:11.424ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82142026-03-03T18:57:11.424ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82152026-03-03T18:57:11.425ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82162026-03-03T18:57:11.431ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") } result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82172026-03-03T18:57:11.431ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82182026-03-03T18:57:11.431ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82192026-03-03T18:57:11.431ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82202026-03-03T18:57:11.432ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
82212026-03-03T18:57:11.434ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
82222026-03-03T18:57:11.434ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
82232026-03-03T18:57:11.435ZDEBGtest_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
82242026-03-03T18:57:11.435ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "name": String("default"), "time_created": String("2026-03-03T18:57:11.418137Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.418137Z")}, "ipv6_prefix": String("fd7f:33b4:15f5::/48"), "project_id": String("0646e606-7015-43d9-9bcf-924637144f52"), "subnet_gen": Number(1), "system_router_id": String("689688b5-13ee-4ea9-8290-d1974c9cb113"), "vni": Number(5257559)}]) node_id = 10 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
82252026-03-03T18:57:11.439ZDEBGtest_metrics (SEC): saga log event new_state = N011 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
82262026-03-03T18:57:11.439ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 11 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
82272026-03-03T18:57:11.442ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82282026-03-03T18:57:11.442ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 0646e606-7015-43d9-9bcf-924637144f52 resource_type = Project saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82292026-03-03T18:57:11.442ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82302026-03-03T18:57:11.442ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82312026-03-03T18:57:11.442ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82322026-03-03T18:57:11.444ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82332026-03-03T18:57:11.444ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82342026-03-03T18:57:11.444ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82352026-03-03T18:57:11.444ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82362026-03-03T18:57:11.455ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82372026-03-03T18:57:11.456ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82382026-03-03T18:57:11.456ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82392026-03-03T18:57:11.456ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82402026-03-03T18:57:11.457ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82412026-03-03T18:57:11.461ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") } result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82422026-03-03T18:57:11.461ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82432026-03-03T18:57:11.461ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82442026-03-03T18:57:11.462ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82452026-03-03T18:57:11.464ZDEBGtest_metrics (SEC): saga log event new_state = N011 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
82462026-03-03T18:57:11.464ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("689688b5-13ee-4ea9-8290-d1974c9cb113"), "lookup_type": Object {"ById": String("689688b5-13ee-4ea9-8290-d1974c9cb113")}, "parent": Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}) node_id = 11 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
82472026-03-03T18:57:11.466ZDEBGtest_metrics (SEC): saga log event new_state = N012 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
82482026-03-03T18:57:11.466ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 12 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
82492026-03-03T18:57:11.468ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") }, key: 689688b5-13ee-4ea9-8290-d1974c9cb113, lookup_type: ById(689688b5-13ee-4ea9-8290-d1974c9cb113) } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82502026-03-03T18:57:11.468ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 0646e606-7015-43d9-9bcf-924637144f52 resource_type = Project saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82512026-03-03T18:57:11.468ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82522026-03-03T18:57:11.468ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82532026-03-03T18:57:11.468ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82542026-03-03T18:57:11.477ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82552026-03-03T18:57:11.477ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82562026-03-03T18:57:11.479ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82572026-03-03T18:57:11.479ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82582026-03-03T18:57:11.480ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82592026-03-03T18:57:11.480ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82602026-03-03T18:57:11.480ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82612026-03-03T18:57:11.480ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82622026-03-03T18:57:11.482ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82632026-03-03T18:57:11.487ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") }, key: 689688b5-13ee-4ea9-8290-d1974c9cb113, lookup_type: ById(689688b5-13ee-4ea9-8290-d1974c9cb113) } result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82642026-03-03T18:57:11.487ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82652026-03-03T18:57:11.487ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82662026-03-03T18:57:11.488ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82672026-03-03T18:57:11.493ZDEBGtest_metrics (SEC): saga log event new_state = N012 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
82682026-03-03T18:57:11.494ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
82692026-03-03T18:57:11.496ZDEBGtest_metrics (SEC): saga log event new_state = N013 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
82702026-03-03T18:57:11.496ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 13 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
82712026-03-03T18:57:11.499ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") }, key: 689688b5-13ee-4ea9-8290-d1974c9cb113, lookup_type: ById(689688b5-13ee-4ea9-8290-d1974c9cb113) } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82722026-03-03T18:57:11.500ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 0646e606-7015-43d9-9bcf-924637144f52 resource_type = Project saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82732026-03-03T18:57:11.500ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82742026-03-03T18:57:11.500ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82752026-03-03T18:57:11.500ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82762026-03-03T18:57:11.501ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82772026-03-03T18:57:11.501ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82782026-03-03T18:57:11.501ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82792026-03-03T18:57:11.502ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82802026-03-03T18:57:11.503ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82812026-03-03T18:57:11.504ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82822026-03-03T18:57:11.504ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82832026-03-03T18:57:11.504ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82842026-03-03T18:57:11.506ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82852026-03-03T18:57:11.511ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") }, key: 689688b5-13ee-4ea9-8290-d1974c9cb113, lookup_type: ById(689688b5-13ee-4ea9-8290-d1974c9cb113) } result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82862026-03-03T18:57:11.513ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82872026-03-03T18:57:11.513ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82882026-03-03T18:57:11.513ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82892026-03-03T18:57:11.515ZDEBGtest_metrics (SEC): saga log event new_state = N013 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
82902026-03-03T18:57:11.515ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
82912026-03-03T18:57:11.517ZDEBGtest_metrics (SEC): saga log event new_state = N014 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
82922026-03-03T18:57:11.517ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 14 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
82932026-03-03T18:57:11.519ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82942026-03-03T18:57:11.519ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 0646e606-7015-43d9-9bcf-924637144f52 resource_type = Project saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82952026-03-03T18:57:11.519ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82962026-03-03T18:57:11.519ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82972026-03-03T18:57:11.520ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82982026-03-03T18:57:11.523ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
82992026-03-03T18:57:11.523ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83002026-03-03T18:57:11.523ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83012026-03-03T18:57:11.524ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83022026-03-03T18:57:11.526ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83032026-03-03T18:57:11.527ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83042026-03-03T18:57:11.527ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83052026-03-03T18:57:11.527ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83062026-03-03T18:57:11.528ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83072026-03-03T18:57:11.532ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") } result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83082026-03-03T18:57:11.533ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
83092026-03-03T18:57:11.533ZDEBGtest_metrics (results-sink-cluster): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
83102026-03-03T18:57:11.535ZDEBGtest_metrics (SEC): saga log event new_state = N014 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
83112026-03-03T18:57:11.535ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546"), "lookup_type": Object {"ById": String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546")}, "parent": Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546"), "name": String("default"), "time_created": String("2026-03-03T18:57:11.519468Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.519468Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd7f:33b4:15f5::/64"), "rcgen": Number(1), "vpc_id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")}]) node_id = 14 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
83122026-03-03T18:57:11.537ZDEBGtest_metrics (SEC): saga log event new_state = N015 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
83132026-03-03T18:57:11.537ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 15 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
83142026-03-03T18:57:11.539ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") }, key: 689688b5-13ee-4ea9-8290-d1974c9cb113, lookup_type: ById(689688b5-13ee-4ea9-8290-d1974c9cb113) } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83152026-03-03T18:57:11.539ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 0646e606-7015-43d9-9bcf-924637144f52 resource_type = Project saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83162026-03-03T18:57:11.539ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83172026-03-03T18:57:11.539ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83182026-03-03T18:57:11.539ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83192026-03-03T18:57:11.545ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83202026-03-03T18:57:11.545ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83212026-03-03T18:57:11.545ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83222026-03-03T18:57:11.545ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83232026-03-03T18:57:11.546ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83242026-03-03T18:57:11.546ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83252026-03-03T18:57:11.546ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83262026-03-03T18:57:11.547ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83272026-03-03T18:57:11.553ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83282026-03-03T18:57:11.558ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") }, key: 689688b5-13ee-4ea9-8290-d1974c9cb113, lookup_type: ById(689688b5-13ee-4ea9-8290-d1974c9cb113) } result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83292026-03-03T18:57:11.558ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83302026-03-03T18:57:11.558ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83312026-03-03T18:57:11.558ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83322026-03-03T18:57:11.566ZDEBGtest_metrics (SEC): saga log event new_state = N015 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
83332026-03-03T18:57:11.566ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("85fd8b62-dabf-41e5-a93a-b85751c2f0d4"), "lookup_type": Object {"ById": String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546")}, "parent": Object {"key": String("689688b5-13ee-4ea9-8290-d1974c9cb113"), "lookup_type": Object {"ById": String("689688b5-13ee-4ea9-8290-d1974c9cb113")}, "parent": Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}) node_id = 15 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
83342026-03-03T18:57:11.568ZDEBGtest_metrics (SEC): saga log event new_state = N016 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
83352026-03-03T18:57:11.570ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 16 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
83362026-03-03T18:57:11.570ZDEBGtest_metrics (nexus): default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: e889d96f-14ce-41a6-a53b-10c019f299d5, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2026-03-03T18:57:11.570195Z, time_modified: 2026-03-03T18:57:11.570195Z, time_deleted: None }, vpc_id: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 16d71b72-63c4-4a2d-bc83-2d2a0209a87f, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2026-03-03T18:57:11.570219Z, time_modified: 2026-03-03T18:57:11.570219Z, time_deleted: None }, vpc_id: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 3a283703-5b66-40e3-9b16-96bf08fde07b, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2026-03-03T18:57:11.570228Z, time_modified: 2026-03-03T18:57:11.570228Z, time_deleted: None }, vpc_id: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp(None))]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
83372026-03-03T18:57:11.570ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83382026-03-03T18:57:11.570ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 0646e606-7015-43d9-9bcf-924637144f52 resource_type = Project saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83392026-03-03T18:57:11.570ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83402026-03-03T18:57:11.570ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83412026-03-03T18:57:11.572ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83422026-03-03T18:57:11.573ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83432026-03-03T18:57:11.574ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83442026-03-03T18:57:11.574ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83452026-03-03T18:57:11.574ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83462026-03-03T18:57:11.575ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83472026-03-03T18:57:11.575ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83482026-03-03T18:57:11.575ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83492026-03-03T18:57:11.576ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83502026-03-03T18:57:11.577ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83512026-03-03T18:57:11.582ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") } result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83522026-03-03T18:57:11.582ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83532026-03-03T18:57:11.582ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83542026-03-03T18:57:11.582ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83552026-03-03T18:57:11.601ZDEBGtest_metrics (SEC): saga log event new_state = N016 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
83562026-03-03T18:57:11.601ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("e889d96f-14ce-41a6-a53b-10c019f299d5"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T18:57:11.570195Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.570195Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("16d71b72-63c4-4a2d-bc83-2d2a0209a87f"), "name": String("allow-ssh"), "time_created": String("2026-03-03T18:57:11.570219Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.570219Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("3a283703-5b66-40e3-9b16-96bf08fde07b"), "name": String("allow-icmp"), "time_created": String("2026-03-03T18:57:11.570228Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.570228Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")}]) node_id = 16 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
83572026-03-03T18:57:11.605ZDEBGtest_metrics (SEC): saga log event new_state = N017 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
83582026-03-03T18:57:11.606ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 17 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
83592026-03-03T18:57:11.608ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83602026-03-03T18:57:11.608ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 0646e606-7015-43d9-9bcf-924637144f52 resource_type = Project saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83612026-03-03T18:57:11.608ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83622026-03-03T18:57:11.608ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83632026-03-03T18:57:11.608ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83642026-03-03T18:57:11.610ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83652026-03-03T18:57:11.610ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83662026-03-03T18:57:11.610ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83672026-03-03T18:57:11.611ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83682026-03-03T18:57:11.620ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83692026-03-03T18:57:11.620ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83702026-03-03T18:57:11.620ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83712026-03-03T18:57:11.620ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83722026-03-03T18:57:11.623ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83732026-03-03T18:57:11.627ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ByName("p-2") }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") } result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83742026-03-03T18:57:11.627ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83752026-03-03T18:57:11.627ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83762026-03-03T18:57:11.628ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83772026-03-03T18:57:11.629ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83782026-03-03T18:57:11.629ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83792026-03-03T18:57:11.630ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83802026-03-03T18:57:11.634ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
83812026-03-03T18:57:11.636ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
83822026-03-03T18:57:11.636ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83832026-03-03T18:57:11.636ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83842026-03-03T18:57:11.636ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83852026-03-03T18:57:11.647ZWARNtest_metrics (SagaExecutor): Default ip pool lookup failed: Invalid Request: Multiple default unicast IP pools exist with different IP versions. Please specify ip_version (v4 or v6) or provide an explicit pool.. Default gateway has no ip pool association authenticated = true saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83862026-03-03T18:57:11.647ZDEBGtest_metrics (SEC): saga log event new_state = N017 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
83872026-03-03T18:57:11.647ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("038eb9db-7389-46a3-b7e4-b4d4720c67a5"), "lookup_type": Object {"ById": String("038eb9db-7389-46a3-b7e4-b4d4720c67a5")}, "parent": Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}) node_id = 17 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
83882026-03-03T18:57:11.649ZDEBGtest_metrics (SEC): saga log event new_state = N018 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
83892026-03-03T18:57:11.649ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 18 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
83902026-03-03T18:57:11.653ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83912026-03-03T18:57:11.653ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83922026-03-03T18:57:11.653ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83932026-03-03T18:57:11.655ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83942026-03-03T18:57:11.655ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83952026-03-03T18:57:11.655ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83962026-03-03T18:57:11.657ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83972026-03-03T18:57:11.657ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83982026-03-03T18:57:11.657ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
83992026-03-03T18:57:11.667ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ById(0646e606-7015-43d9-9bcf-924637144f52) }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84002026-03-03T18:57:11.667ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 0646e606-7015-43d9-9bcf-924637144f52 resource_type = Project saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84012026-03-03T18:57:11.667ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84022026-03-03T18:57:11.667ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84032026-03-03T18:57:11.668ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84042026-03-03T18:57:11.674ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84052026-03-03T18:57:11.674ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84062026-03-03T18:57:11.674ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84072026-03-03T18:57:11.677ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84082026-03-03T18:57:11.679ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84092026-03-03T18:57:11.679ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84102026-03-03T18:57:11.679ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84112026-03-03T18:57:11.680ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84122026-03-03T18:57:11.682ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84132026-03-03T18:57:11.687ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ById(0646e606-7015-43d9-9bcf-924637144f52) }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") } result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84142026-03-03T18:57:11.687ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ById(0646e606-7015-43d9-9bcf-924637144f52) }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84152026-03-03T18:57:11.687ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 0646e606-7015-43d9-9bcf-924637144f52 resource_type = Project saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84162026-03-03T18:57:11.687ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84172026-03-03T18:57:11.687ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84182026-03-03T18:57:11.687ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84192026-03-03T18:57:11.689ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84202026-03-03T18:57:11.689ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84212026-03-03T18:57:11.689ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84222026-03-03T18:57:11.689ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84232026-03-03T18:57:11.691ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84242026-03-03T18:57:11.691ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84252026-03-03T18:57:11.691ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84262026-03-03T18:57:11.691ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84272026-03-03T18:57:11.693ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84282026-03-03T18:57:11.699ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ById(0646e606-7015-43d9-9bcf-924637144f52) }, key: 41da2ad3-1e42-4a41-96ed-9cbe077b38fb, lookup_type: ByName("default") } result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84292026-03-03T18:57:11.699ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84302026-03-03T18:57:11.699ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84312026-03-03T18:57:11.700ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84322026-03-03T18:57:11.709ZDEBGtest_metrics (nexus): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
84332026-03-03T18:57:11.716ZDEBGtest_metrics (nexus): resolved firewall rules for sled agents sled_agent_rules = []
84342026-03-03T18:57:11.716ZDEBGtest_metrics (nexus): resolved 0 rules for sleds
84352026-03-03T18:57:11.736ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
84362026-03-03T18:57:11.756ZDEBGtest_metrics (nexus): resolved sleds for vpc default vpc_to_sled = []
84372026-03-03T18:57:11.757ZDEBGtest_metrics (nexus): sending firewall rules to sled agents
84382026-03-03T18:57:11.757ZINFOtest_metrics (nexus): updated firewall rules on 0 sleds
84392026-03-03T18:57:11.757ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84402026-03-03T18:57:11.757ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84412026-03-03T18:57:11.757ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
84422026-03-03T18:57:11.759ZDEBGtest_metrics (SEC): saga log event new_state = N018 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
84432026-03-03T18:57:11.760ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
84442026-03-03T18:57:11.763ZDEBGtest_metrics (SEC): saga log event new_state = N019 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
84452026-03-03T18:57:11.763ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 19 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
84462026-03-03T18:57:11.765ZDEBGtest_metrics (SEC): saga log event new_state = N019 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
84472026-03-03T18:57:11.770ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
84482026-03-03T18:57:11.770ZDEBGtest_metrics (SEC): saga log event new_state = N021 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
84492026-03-03T18:57:11.770ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 21 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
84502026-03-03T18:57:11.770ZDEBGtest_metrics (SEC): saga log event new_state = N021 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
84512026-03-03T18:57:11.770ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 21 saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
84522026-03-03T18:57:11.770ZINFOtest_metrics (SEC): update for saga cached state new_state = Done saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 sec_id = 913233fe-92a8-4635-9572-183f495429c4
84532026-03-03T18:57:11.770ZINFOtest_metrics (SecStore): updating state new_state = done saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
84542026-03-03T18:57:11.772ZINFOtest_metrics (SEC): saga finished result = success saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
84552026-03-03T18:57:11.772ZINFOtest_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362
84562026-03-03T18:57:11.772ZINFOtest_metrics (SagaExecutor): saga finished saga_id = d56eb1ba-e04d-4a9a-8d25-d4329d0a5362 saga_name = project-create saga_result = SagaResult { saga_id: d56eb1ba-e04d-4a9a-8d25-d4329d0a5362, saga_log: SagaLog { saga_id: d56eb1ba-e04d-4a9a-8d25-d4329d0a5362, unwinding: false, events: [N020 started, N020 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N016 started, N016 succeeded, N017 started, N017 succeeded, N018 started, N018 succeeded, N019 started, N019 succeeded, N021 started, N021 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("0646e606-7015-43d9-9bcf-924637144f52"), "name": String("p-2"), "time_created": String("2026-03-03T18:57:11.346731Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.346731Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd7f:33b4:15f5::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")), 4: Succeeded(String("689688b5-13ee-4ea9-8290-d1974c9cb113")), 5: Succeeded(String("1c648985-a170-4460-bbf7-7464432e653d")), 6: Succeeded(String("9a975a39-e8b1-4ea1-adb9-d2f105758c5c")), 7: Succeeded(String("85fd8b62-dabf-41e5-a93a-b85751c2f0d4")), 8: Succeeded(String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546")), 9: Succeeded(String("038eb9db-7389-46a3-b7e4-b4d4720c67a5")), 10: Succeeded(Array [Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "name": String("default"), "time_created": String("2026-03-03T18:57:11.418137Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.418137Z")}, "ipv6_prefix": String("fd7f:33b4:15f5::/48"), "project_id": String("0646e606-7015-43d9-9bcf-924637144f52"), "subnet_gen": Number(1), "system_router_id": String("689688b5-13ee-4ea9-8290-d1974c9cb113"), "vni": Number(5257559)}]), 11: Succeeded(Object {"key": String("689688b5-13ee-4ea9-8290-d1974c9cb113"), "lookup_type": Object {"ById": String("689688b5-13ee-4ea9-8290-d1974c9cb113")}, "parent": Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Array [Object {"key": String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546"), "lookup_type": Object {"ById": String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546")}, "parent": Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546"), "name": String("default"), "time_created": String("2026-03-03T18:57:11.519468Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.519468Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd7f:33b4:15f5::/64"), "rcgen": Number(1), "vpc_id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")}]), 15: Succeeded(Object {"key": String("85fd8b62-dabf-41e5-a93a-b85751c2f0d4"), "lookup_type": Object {"ById": String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546")}, "parent": Object {"key": String("689688b5-13ee-4ea9-8290-d1974c9cb113"), "lookup_type": Object {"ById": String("689688b5-13ee-4ea9-8290-d1974c9cb113")}, "parent": Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}), 16: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("e889d96f-14ce-41a6-a53b-10c019f299d5"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T18:57:11.570195Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.570195Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("16d71b72-63c4-4a2d-bc83-2d2a0209a87f"), "name": String("allow-ssh"), "time_created": String("2026-03-03T18:57:11.570219Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.570219Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("3a283703-5b66-40e3-9b16-96bf08fde07b"), "name": String("allow-icmp"), "time_created": String("2026-03-03T18:57:11.570228Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.570228Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")}]), 17: Succeeded(Object {"key": String("038eb9db-7389-46a3-b7e4-b4d4720c67a5"), "lookup_type": Object {"ById": String("038eb9db-7389-46a3-b7e4-b4d4720c67a5")}, "parent": Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}), 18: Succeeded(Null), 19: Succeeded(Null), 20: Succeeded(Null), 21: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_internet_gateway_id": String("038eb9db-7389-46a3-b7e4-b4d4720c67a5"), "default_subnet_id": String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546"), "default_v4_route_id": String("1c648985-a170-4460-bbf7-7464432e653d"), "default_v6_route_id": String("9a975a39-e8b1-4ea1-adb9-d2f105758c5c"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("e889d96f-14ce-41a6-a53b-10c019f299d5"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T18:57:11.570195Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.570195Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("16d71b72-63c4-4a2d-bc83-2d2a0209a87f"), "name": String("allow-ssh"), "time_created": String("2026-03-03T18:57:11.570219Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.570219Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("3a283703-5b66-40e3-9b16-96bf08fde07b"), "name": String("allow-icmp"), "time_created": String("2026-03-03T18:57:11.570228Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.570228Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")}], "gateway": Object {"key": String("038eb9db-7389-46a3-b7e4-b4d4720c67a5"), "lookup_type": Object {"ById": String("038eb9db-7389-46a3-b7e4-b4d4720c67a5")}, "parent": Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, "no_result": Null, "project": Array [Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("0646e606-7015-43d9-9bcf-924637144f52"), "name": String("p-2"), "time_created": String("2026-03-03T18:57:11.346731Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.346731Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}], "route": Object {"key": String("85fd8b62-dabf-41e5-a93a-b85751c2f0d4"), "lookup_type": Object {"ById": String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546")}, "parent": Object {"key": String("689688b5-13ee-4ea9-8290-d1974c9cb113"), "lookup_type": Object {"ById": String("689688b5-13ee-4ea9-8290-d1974c9cb113")}, "parent": Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}, "route4": Null, "route6": Null, "router": Object {"key": String("689688b5-13ee-4ea9-8290-d1974c9cb113"), "lookup_type": Object {"ById": String("689688b5-13ee-4ea9-8290-d1974c9cb113")}, "parent": Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546"), "lookup_type": Object {"ById": String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546")}, "parent": Object {"key": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("aa58e8e4-e8fb-4d67-b5d8-8347f9518546"), "name": String("default"), "time_created": String("2026-03-03T18:57:11.519468Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:11.519468Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd7f:33b4:15f5::/64"), "rcgen": Number(1), "vpc_id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")}], "subnet_route_id": String("85fd8b62-dabf-41e5-a93a-b85751c2f0d4"), "system_router_id": String("689688b5-13ee-4ea9-8290-d1974c9cb113"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("0646e606-7015-43d9-9bcf-924637144f52"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd7f:33b4:15f5::/48"), "name": String("default")}}, "vpc_id": String("41da2ad3-1e42-4a41-96ed-9cbe077b38fb")} }) }
84572026-03-03T18:57:11.775ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
84582026-03-03T18:57:11.775ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
84592026-03-03T18:57:11.775ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
84602026-03-03T18:57:11.775ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
84612026-03-03T18:57:11.775ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
84622026-03-03T18:57:11.775ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
84632026-03-03T18:57:11.777ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
84642026-03-03T18:57:11.778ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
84652026-03-03T18:57:11.778ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
84662026-03-03T18:57:11.778ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
84672026-03-03T18:57:11.809ZINFOtest_metrics (dropshot_external): request completed latency_us = 549289 local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = c5a33701-6ed5-48e5-ad6d-2b6205f90e2c response_code = 201 uri = /v1/projects
84682026-03-03T18:57:11.809ZINFOtest_metrics (external client test context): client received response status = 201
84692026-03-03T18:57:11.809ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
84702026-03-03T18:57:11.811ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
84712026-03-03T18:57:11.811ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
84722026-03-03T18:57:11.811ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
84732026-03-03T18:57:11.811ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
84742026-03-03T18:57:11.811ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
84752026-03-03T18:57:11.811ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
84762026-03-03T18:57:11.811ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
84772026-03-03T18:57:11.811ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52 version = 2026021900.0.0
84782026-03-03T18:57:11.811ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 613df209-3542-439f-aa2e-fb59fe87fda3 uri = /913233fe-92a8-4635-9572-183f495429c4
84792026-03-03T18:57:11.811ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
84802026-03-03T18:57:11.811ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
84812026-03-03T18:57:11.811ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84822026-03-03T18:57:11.811ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84832026-03-03T18:57:11.811ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84842026-03-03T18:57:11.816ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6341 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 613df209-3542-439f-aa2e-fb59fe87fda3 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
84852026-03-03T18:57:11.817ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
84862026-03-03T18:57:11.824ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
84872026-03-03T18:57:11.824ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
84882026-03-03T18:57:11.824ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
84892026-03-03T18:57:11.824ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
84902026-03-03T18:57:11.824ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
84912026-03-03T18:57:11.825ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
84922026-03-03T18:57:11.825ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
84932026-03-03T18:57:11.825ZDEBGtest_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
84942026-03-03T18:57:11.825ZDEBGtest_metrics (results-sink-cluster): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
84952026-03-03T18:57:11.825ZDEBGtest_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
84962026-03-03T18:57:11.831ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 26 sql = INSERT INTO oximeter.fields_string FORMAT Native
84972026-03-03T18:57:11.832ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84982026-03-03T18:57:11.832ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84992026-03-03T18:57:11.832ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85002026-03-03T18:57:11.834ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 26 table_name = fields_string
85012026-03-03T18:57:11.834ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
85022026-03-03T18:57:11.836ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = fields_u16
85032026-03-03T18:57:11.836ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
85042026-03-03T18:57:11.836ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
85052026-03-03T18:57:11.836ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
85062026-03-03T18:57:11.836ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85072026-03-03T18:57:11.836ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85082026-03-03T18:57:11.837ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85092026-03-03T18:57:11.838ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_uuid
85102026-03-03T18:57:11.838ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
85112026-03-03T18:57:11.838ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
85122026-03-03T18:57:11.838ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85132026-03-03T18:57:11.839ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85142026-03-03T18:57:11.839ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85152026-03-03T18:57:11.840ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
85162026-03-03T18:57:11.843ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
85172026-03-03T18:57:11.843ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85182026-03-03T18:57:11.843ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85192026-03-03T18:57:11.843ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85202026-03-03T18:57:11.844ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = measurements_histogramu64
85212026-03-03T18:57:11.844ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 4 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
85222026-03-03T18:57:11.845ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
85232026-03-03T18:57:11.845ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
85242026-03-03T18:57:11.845ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85252026-03-03T18:57:11.845ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85262026-03-03T18:57:11.845ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85272026-03-03T18:57:11.846ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 4 table_name = measurements_i64
85282026-03-03T18:57:11.846ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
85292026-03-03T18:57:11.846ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
85302026-03-03T18:57:11.846ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
85312026-03-03T18:57:11.847ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
85322026-03-03T18:57:11.848ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
85332026-03-03T18:57:11.848ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85342026-03-03T18:57:11.848ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85352026-03-03T18:57:11.849ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85362026-03-03T18:57:11.850ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
85372026-03-03T18:57:11.850ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
85382026-03-03T18:57:11.851ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
85392026-03-03T18:57:11.856ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
85402026-03-03T18:57:11.856ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85412026-03-03T18:57:11.856ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85422026-03-03T18:57:11.856ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85432026-03-03T18:57:11.856ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85442026-03-03T18:57:11.856ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85452026-03-03T18:57:11.856ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85462026-03-03T18:57:11.856ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
85472026-03-03T18:57:11.857ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
85482026-03-03T18:57:11.857ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85492026-03-03T18:57:11.857ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85502026-03-03T18:57:11.857ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85512026-03-03T18:57:11.857ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85522026-03-03T18:57:11.865ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85532026-03-03T18:57:11.867ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85542026-03-03T18:57:11.867ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85552026-03-03T18:57:11.867ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85562026-03-03T18:57:11.867ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85572026-03-03T18:57:11.869ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85582026-03-03T18:57:11.869ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85592026-03-03T18:57:11.879ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85602026-03-03T18:57:11.881ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ById(0646e606-7015-43d9-9bcf-924637144f52) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85612026-03-03T18:57:11.881ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource_id = 0646e606-7015-43d9-9bcf-924637144f52 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85622026-03-03T18:57:11.881ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85632026-03-03T18:57:11.881ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85642026-03-03T18:57:11.881ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85652026-03-03T18:57:11.883ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85662026-03-03T18:57:11.883ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85672026-03-03T18:57:11.883ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85682026-03-03T18:57:11.884ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85692026-03-03T18:57:11.886ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85702026-03-03T18:57:11.887ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85712026-03-03T18:57:11.887ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85722026-03-03T18:57:11.887ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85732026-03-03T18:57:11.889ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85742026-03-03T18:57:11.896ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ById(0646e606-7015-43d9-9bcf-924637144f52) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85752026-03-03T18:57:11.897ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85762026-03-03T18:57:11.897ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85772026-03-03T18:57:11.897ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85782026-03-03T18:57:11.897ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85792026-03-03T18:57:11.897ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85802026-03-03T18:57:11.899ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85812026-03-03T18:57:11.899ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85822026-03-03T18:57:11.899ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85832026-03-03T18:57:11.899ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85842026-03-03T18:57:11.901ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85852026-03-03T18:57:11.909ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85862026-03-03T18:57:11.909ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '0646e606-7015-43d9-9bcf-924637144f52') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
85872026-03-03T18:57:11.917ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (13711803654608722169) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:11.809591824' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
85882026-03-03T18:57:11.919ZINFOtest_metrics (dropshot_external): request completed latency_us = 109148 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = aa9869c3-d8db-42b8-aa3c-2d02c03352d7 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.809591824Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85892026-03-03T18:57:11.919ZINFOtest_metrics (external client test context): client received response status = 200
85902026-03-03T18:57:11.919ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85912026-03-03T18:57:11.920ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
85922026-03-03T18:57:11.920ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
85932026-03-03T18:57:11.920ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
85942026-03-03T18:57:11.920ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
85952026-03-03T18:57:11.920ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
85962026-03-03T18:57:11.920ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
85972026-03-03T18:57:11.920ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
85982026-03-03T18:57:11.920ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52 version = 2026021900.0.0
85992026-03-03T18:57:11.920ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = b509dee0-55c8-4e15-9d5a-fc9d9abdea3b uri = /913233fe-92a8-4635-9572-183f495429c4
86002026-03-03T18:57:11.920ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86012026-03-03T18:57:11.920ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86022026-03-03T18:57:11.920ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86032026-03-03T18:57:11.920ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86042026-03-03T18:57:11.921ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86052026-03-03T18:57:11.927ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7095 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = b509dee0-55c8-4e15-9d5a-fc9d9abdea3b response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
86062026-03-03T18:57:11.928ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
86072026-03-03T18:57:11.933ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
86082026-03-03T18:57:11.934ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
86092026-03-03T18:57:11.934ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
86102026-03-03T18:57:11.934ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
86112026-03-03T18:57:11.934ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
86122026-03-03T18:57:11.934ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
86132026-03-03T18:57:11.934ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
86142026-03-03T18:57:11.936ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
86152026-03-03T18:57:11.936ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
86162026-03-03T18:57:11.937ZDEBGtest_metrics (results-sink): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
86172026-03-03T18:57:11.937ZDEBGtest_metrics (clickhouse-client): unrolling 12 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
86182026-03-03T18:57:11.942ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 24 sql = INSERT INTO oximeter.fields_string FORMAT Native
86192026-03-03T18:57:11.950ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86202026-03-03T18:57:11.952ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86212026-03-03T18:57:11.952ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86222026-03-03T18:57:11.952ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 24 table_name = fields_string
86232026-03-03T18:57:11.952ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
86242026-03-03T18:57:11.952ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
86252026-03-03T18:57:11.952ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
86262026-03-03T18:57:11.952ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86272026-03-03T18:57:11.952ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86282026-03-03T18:57:11.952ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86292026-03-03T18:57:11.952ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = fields_u16
86302026-03-03T18:57:11.952ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
86312026-03-03T18:57:11.952ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
86322026-03-03T18:57:11.952ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86332026-03-03T18:57:11.952ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86342026-03-03T18:57:11.952ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86352026-03-03T18:57:11.953ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = fields_uuid
86362026-03-03T18:57:11.953ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
86372026-03-03T18:57:11.953ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
86382026-03-03T18:57:11.955ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
86392026-03-03T18:57:11.955ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86402026-03-03T18:57:11.955ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86412026-03-03T18:57:11.956ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86422026-03-03T18:57:11.969ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
86432026-03-03T18:57:11.969ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
86442026-03-03T18:57:11.969ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86452026-03-03T18:57:11.969ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86462026-03-03T18:57:11.970ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86472026-03-03T18:57:11.971ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = measurements_histogramu64
86482026-03-03T18:57:11.971ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
86492026-03-03T18:57:11.971ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
86502026-03-03T18:57:11.971ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
86512026-03-03T18:57:11.972ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
86522026-03-03T18:57:11.983ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
86532026-03-03T18:57:11.983ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86542026-03-03T18:57:11.983ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86552026-03-03T18:57:11.984ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86562026-03-03T18:57:12.012ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
86572026-03-03T18:57:12.012ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
86582026-03-03T18:57:12.013ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
86592026-03-03T18:57:12.015ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
86602026-03-03T18:57:12.015ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86612026-03-03T18:57:12.015ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86622026-03-03T18:57:12.015ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86632026-03-03T18:57:12.015ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86642026-03-03T18:57:12.015ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86652026-03-03T18:57:12.016ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86662026-03-03T18:57:12.016ZDEBGtest_metrics (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 3 reason = Timeout
86672026-03-03T18:57:12.016ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig
86682026-03-03T18:57:12.016ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = reconfigurator_config_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
86692026-03-03T18:57:12.017ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
86702026-03-03T18:57:12.017ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
86712026-03-03T18:57:12.017ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
86722026-03-03T18:57:12.021ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
86732026-03-03T18:57:12.021ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
86742026-03-03T18:57:12.021ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86752026-03-03T18:57:12.023ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
86762026-03-03T18:57:12.023ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
86772026-03-03T18:57:12.023ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
86782026-03-03T18:57:12.024ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
86792026-03-03T18:57:12.031ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86802026-03-03T18:57:12.032ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86812026-03-03T18:57:12.032ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86822026-03-03T18:57:12.077ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86832026-03-03T18:57:12.078ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
86842026-03-03T18:57:12.078ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
86852026-03-03T18:57:12.078ZDEBGtest_metrics (results-sink-cluster): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
86862026-03-03T18:57:12.080ZDEBGtest_metrics (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: false, planner_config: PlannerConfig { add_zones_with_mupdate_override: false }, tuf_repo_pruner_enabled: true }, time_modified: 2026-03-03T18:57:01.943241Z })
86872026-03-03T18:57:12.080ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 63.464772ms iteration = 3 status = {"config_updated":false}
86882026-03-03T18:57:12.080ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86892026-03-03T18:57:12.082ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86902026-03-03T18:57:12.082ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86912026-03-03T18:57:12.082ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86922026-03-03T18:57:12.083ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86932026-03-03T18:57:12.084ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86942026-03-03T18:57:12.084ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86952026-03-03T18:57:12.084ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86962026-03-03T18:57:12.087ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ById(0646e606-7015-43d9-9bcf-924637144f52) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86972026-03-03T18:57:12.087ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource_id = 0646e606-7015-43d9-9bcf-924637144f52 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86982026-03-03T18:57:12.087ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
86992026-03-03T18:57:12.087ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87002026-03-03T18:57:12.087ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87012026-03-03T18:57:12.094ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87022026-03-03T18:57:12.094ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87032026-03-03T18:57:12.094ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87042026-03-03T18:57:12.095ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87052026-03-03T18:57:12.099ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87062026-03-03T18:57:12.099ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87072026-03-03T18:57:12.099ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87082026-03-03T18:57:12.100ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87092026-03-03T18:57:12.104ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87102026-03-03T18:57:12.111ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ById(0646e606-7015-43d9-9bcf-924637144f52) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87112026-03-03T18:57:12.111ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87122026-03-03T18:57:12.111ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87132026-03-03T18:57:12.111ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87142026-03-03T18:57:12.111ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87152026-03-03T18:57:12.111ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87162026-03-03T18:57:12.116ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87172026-03-03T18:57:12.116ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87182026-03-03T18:57:12.116ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87192026-03-03T18:57:12.117ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87202026-03-03T18:57:12.124ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87212026-03-03T18:57:12.128ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87222026-03-03T18:57:12.130ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '0646e606-7015-43d9-9bcf-924637144f52') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
87232026-03-03T18:57:12.134ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (1275735492251400294) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:11.919859670' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
87242026-03-03T18:57:12.137ZINFOtest_metrics (dropshot_external): request completed latency_us = 216991 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f1ba6044-ac08-42a8-b9ae-09f178852d70 response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:11.919859670Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87252026-03-03T18:57:12.138ZINFOtest_metrics (external client test context): client received response status = 200
87262026-03-03T18:57:12.138ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87272026-03-03T18:57:12.139ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
87282026-03-03T18:57:12.139ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
87292026-03-03T18:57:12.139ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
87302026-03-03T18:57:12.139ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
87312026-03-03T18:57:12.139ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
87322026-03-03T18:57:12.139ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
87332026-03-03T18:57:12.139ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87342026-03-03T18:57:12.139ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52 version = 2026021900.0.0
87352026-03-03T18:57:12.139ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 6d6d9aaa-f467-4e32-a106-10d9ad6cd95c uri = /913233fe-92a8-4635-9572-183f495429c4
87362026-03-03T18:57:12.139ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87372026-03-03T18:57:12.139ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
87382026-03-03T18:57:12.139ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
87392026-03-03T18:57:12.139ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
87402026-03-03T18:57:12.140ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
87412026-03-03T18:57:12.147ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 8279 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 6d6d9aaa-f467-4e32-a106-10d9ad6cd95c response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
87422026-03-03T18:57:12.148ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
87432026-03-03T18:57:12.154ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
87442026-03-03T18:57:12.154ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
87452026-03-03T18:57:12.154ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
87462026-03-03T18:57:12.154ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
87472026-03-03T18:57:12.154ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
87482026-03-03T18:57:12.154ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
87492026-03-03T18:57:12.154ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
87502026-03-03T18:57:12.155ZDEBGtest_metrics (results-sink): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
87512026-03-03T18:57:12.155ZDEBGtest_metrics (clickhouse-client): unrolling 12 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
87522026-03-03T18:57:12.159ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 24 sql = INSERT INTO oximeter.fields_string FORMAT Native
87532026-03-03T18:57:12.159ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
87542026-03-03T18:57:12.159ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
87552026-03-03T18:57:12.160ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
87562026-03-03T18:57:12.161ZINFOtest_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
87572026-03-03T18:57:12.161ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
87582026-03-03T18:57:12.162ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 4f0033a5-4c15-47bb-ac93-153c0b43bed6 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
87592026-03-03T18:57:12.162ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 4f0033a5-4c15-47bb-ac93-153c0b43bed6 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
87602026-03-03T18:57:12.162ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 4f0033a5-4c15-47bb-ac93-153c0b43bed6 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
87612026-03-03T18:57:12.163ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 4f0033a5-4c15-47bb-ac93-153c0b43bed6 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
87622026-03-03T18:57:12.163ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 4f0033a5-4c15-47bb-ac93-153c0b43bed6 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
87632026-03-03T18:57:12.164ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 24 table_name = fields_string
87642026-03-03T18:57:12.164ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
87652026-03-03T18:57:12.171ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
87662026-03-03T18:57:12.171ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
87672026-03-03T18:57:12.171ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
87682026-03-03T18:57:12.171ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
87692026-03-03T18:57:12.172ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
87702026-03-03T18:57:12.173ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = fields_u16
87712026-03-03T18:57:12.173ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
87722026-03-03T18:57:12.175ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
87732026-03-03T18:57:12.175ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
87742026-03-03T18:57:12.175ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
87752026-03-03T18:57:12.176ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
87762026-03-03T18:57:12.177ZINFOtest_metrics (dropshot_internal): request completed latency_us = 14894 local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 4f0033a5-4c15-47bb-ac93-153c0b43bed6 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
87772026-03-03T18:57:12.177ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = fields_uuid
87782026-03-03T18:57:12.177ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
87792026-03-03T18:57:12.177ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f0033a5-4c15-47bb-ac93-153c0b43bed6", "content-length": "405", "date": "Tue, 03 Mar 2026 18:57:12 GMT"} })
87802026-03-03T18:57:12.178ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
87812026-03-03T18:57:12.178ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
87822026-03-03T18:57:12.180ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
87832026-03-03T18:57:12.180ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
87842026-03-03T18:57:12.180ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
87852026-03-03T18:57:12.180ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
87862026-03-03T18:57:12.181ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = de166864-3c6a-4f1b-ae98-37b1aaaf3717 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
87872026-03-03T18:57:12.181ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = de166864-3c6a-4f1b-ae98-37b1aaaf3717 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D version = 1.0.0
87882026-03-03T18:57:12.183ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = de166864-3c6a-4f1b-ae98-37b1aaaf3717 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
87892026-03-03T18:57:12.183ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = de166864-3c6a-4f1b-ae98-37b1aaaf3717 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
87902026-03-03T18:57:12.184ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = de166864-3c6a-4f1b-ae98-37b1aaaf3717 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
87912026-03-03T18:57:12.184ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
87922026-03-03T18:57:12.184ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
87932026-03-03T18:57:12.185ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 12 table_name = measurements_histogramu64
87942026-03-03T18:57:12.185ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
87952026-03-03T18:57:12.185ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
87962026-03-03T18:57:12.185ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
87972026-03-03T18:57:12.186ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
87982026-03-03T18:57:12.186ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
87992026-03-03T18:57:12.186ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
88002026-03-03T18:57:12.186ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88012026-03-03T18:57:12.186ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88022026-03-03T18:57:12.187ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88032026-03-03T18:57:12.187ZINFOtest_metrics (dropshot_internal): request completed latency_us = 6478 local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = de166864-3c6a-4f1b-ae98-37b1aaaf3717 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
88042026-03-03T18:57:12.188ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "de166864-3c6a-4f1b-ae98-37b1aaaf3717", "content-length": "29", "date": "Tue, 03 Mar 2026 18:57:12 GMT"} })
88052026-03-03T18:57:12.188ZTRACtest_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4
88062026-03-03T18:57:12.188ZTRACtest_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
88072026-03-03T18:57:12.188ZINFOtest_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
88082026-03-03T18:57:12.188ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
88092026-03-03T18:57:12.188ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
88102026-03-03T18:57:12.189ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
88112026-03-03T18:57:12.189ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88122026-03-03T18:57:12.189ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88132026-03-03T18:57:12.190ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88142026-03-03T18:57:12.192ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
88152026-03-03T18:57:12.192ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
88162026-03-03T18:57:12.192ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
88172026-03-03T18:57:12.196ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
88182026-03-03T18:57:12.196ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88192026-03-03T18:57:12.196ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88202026-03-03T18:57:12.196ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88212026-03-03T18:57:12.196ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88222026-03-03T18:57:12.196ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88232026-03-03T18:57:12.196ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88242026-03-03T18:57:12.197ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
88252026-03-03T18:57:12.197ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
88262026-03-03T18:57:12.199ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
88272026-03-03T18:57:12.199ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
88282026-03-03T18:57:12.199ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
88292026-03-03T18:57:12.199ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
88302026-03-03T18:57:12.200ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88312026-03-03T18:57:12.200ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88322026-03-03T18:57:12.200ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88332026-03-03T18:57:12.201ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88342026-03-03T18:57:12.202ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88352026-03-03T18:57:12.204ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88362026-03-03T18:57:12.204ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88372026-03-03T18:57:12.204ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88382026-03-03T18:57:12.205ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88392026-03-03T18:57:12.206ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88402026-03-03T18:57:12.206ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88412026-03-03T18:57:12.206ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88422026-03-03T18:57:12.207ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ById(0646e606-7015-43d9-9bcf-924637144f52) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88432026-03-03T18:57:12.207ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource_id = 0646e606-7015-43d9-9bcf-924637144f52 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88442026-03-03T18:57:12.207ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88452026-03-03T18:57:12.207ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88462026-03-03T18:57:12.208ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88472026-03-03T18:57:12.209ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88482026-03-03T18:57:12.209ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88492026-03-03T18:57:12.209ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88502026-03-03T18:57:12.210ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88512026-03-03T18:57:12.212ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88522026-03-03T18:57:12.212ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88532026-03-03T18:57:12.212ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88542026-03-03T18:57:12.213ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88552026-03-03T18:57:12.221ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88562026-03-03T18:57:12.226ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 0646e606-7015-43d9-9bcf-924637144f52, lookup_type: ById(0646e606-7015-43d9-9bcf-924637144f52) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88572026-03-03T18:57:12.226ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88582026-03-03T18:57:12.227ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88592026-03-03T18:57:12.227ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88602026-03-03T18:57:12.227ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88612026-03-03T18:57:12.227ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88622026-03-03T18:57:12.229ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88632026-03-03T18:57:12.230ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88642026-03-03T18:57:12.230ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88652026-03-03T18:57:12.230ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88662026-03-03T18:57:12.232ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88672026-03-03T18:57:12.234ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88682026-03-03T18:57:12.236ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '0646e606-7015-43d9-9bcf-924637144f52') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
88692026-03-03T18:57:12.249ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (2698518691760496430) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:12.138814561' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
88702026-03-03T18:57:12.257ZINFOtest_metrics (dropshot_external): request completed latency_us = 114144 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f529afc9-edcf-4a77-8537-241c3908629b response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.138814561Z&order=descending&limit=1&project=0646e606-7015-43d9-9bcf-924637144f52
88712026-03-03T18:57:12.257ZINFOtest_metrics (external client test context): client received response status = 200
88722026-03-03T18:57:12.257ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
88732026-03-03T18:57:12.257ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
88742026-03-03T18:57:12.257ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
88752026-03-03T18:57:12.257ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
88762026-03-03T18:57:12.257ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
88772026-03-03T18:57:12.257ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88782026-03-03T18:57:12.257ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88792026-03-03T18:57:12.257ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88802026-03-03T18:57:12.257ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88812026-03-03T18:57:12.257ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88822026-03-03T18:57:12.257ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88832026-03-03T18:57:12.259ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
88842026-03-03T18:57:12.259ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
88852026-03-03T18:57:12.259ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88862026-03-03T18:57:12.259ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88872026-03-03T18:57:12.259ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88882026-03-03T18:57:12.260ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
88892026-03-03T18:57:12.261ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88902026-03-03T18:57:12.261ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88912026-03-03T18:57:12.261ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88922026-03-03T18:57:12.263ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
88932026-03-03T18:57:12.265ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
88942026-03-03T18:57:12.265ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88952026-03-03T18:57:12.265ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88962026-03-03T18:57:12.265ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88972026-03-03T18:57:12.267ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
88982026-03-03T18:57:12.267ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
88992026-03-03T18:57:12.267ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89002026-03-03T18:57:12.267ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89012026-03-03T18:57:12.267ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89022026-03-03T18:57:12.275ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
89032026-03-03T18:57:12.275ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89042026-03-03T18:57:12.275ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89052026-03-03T18:57:12.276ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89062026-03-03T18:57:12.278ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
89072026-03-03T18:57:12.280ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
89082026-03-03T18:57:12.280ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89092026-03-03T18:57:12.280ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89102026-03-03T18:57:12.280ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89112026-03-03T18:57:12.280ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89122026-03-03T18:57:12.280ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89132026-03-03T18:57:12.281ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89142026-03-03T18:57:12.283ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89152026-03-03T18:57:12.283ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89162026-03-03T18:57:12.283ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89172026-03-03T18:57:12.283ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89182026-03-03T18:57:12.288ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
89192026-03-03T18:57:12.288ZDEBGtest_metrics (results-sink-cluster): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
89202026-03-03T18:57:12.289ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89212026-03-03T18:57:12.290ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89222026-03-03T18:57:12.290ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89232026-03-03T18:57:12.290ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89242026-03-03T18:57:12.291ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89252026-03-03T18:57:12.295ZINFOtest_metrics (dropshot_external): request completed error_message_external = not found: project with id "001de000-5110-4000-8000-000000000000" error_message_internal = not found: project with id "001de000-5110-4000-8000-000000000000" latency_us = 41743 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 6fc20027-8111-474d-9102-5f25fcfcbef3 response_code = 404 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.253951705Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
89262026-03-03T18:57:12.296ZINFOtest_metrics (external client test context): client received response status = 404
89272026-03-03T18:57:12.296ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89282026-03-03T18:57:12.296ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89292026-03-03T18:57:12.296ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493 version = 2026021900.0.0
89302026-03-03T18:57:12.297ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89312026-03-03T18:57:12.297ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89322026-03-03T18:57:12.297ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89332026-03-03T18:57:12.297ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89342026-03-03T18:57:12.297ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89352026-03-03T18:57:12.300ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89362026-03-03T18:57:12.300ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89372026-03-03T18:57:12.300ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89382026-03-03T18:57:12.302ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
89392026-03-03T18:57:12.302ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
89402026-03-03T18:57:12.302ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89412026-03-03T18:57:12.302ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89422026-03-03T18:57:12.303ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89432026-03-03T18:57:12.304ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
89442026-03-03T18:57:12.304ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89452026-03-03T18:57:12.304ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89462026-03-03T18:57:12.305ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89472026-03-03T18:57:12.306ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
89482026-03-03T18:57:12.309ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
89492026-03-03T18:57:12.309ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89502026-03-03T18:57:12.309ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89512026-03-03T18:57:12.309ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89522026-03-03T18:57:12.311ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
89532026-03-03T18:57:12.311ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
89542026-03-03T18:57:12.311ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89552026-03-03T18:57:12.311ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89562026-03-03T18:57:12.311ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89572026-03-03T18:57:12.313ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
89582026-03-03T18:57:12.313ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89592026-03-03T18:57:12.313ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89602026-03-03T18:57:12.313ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89612026-03-03T18:57:12.315ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
89622026-03-03T18:57:12.317ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
89632026-03-03T18:57:12.317ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89642026-03-03T18:57:12.317ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89652026-03-03T18:57:12.317ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89662026-03-03T18:57:12.317ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89672026-03-03T18:57:12.317ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89682026-03-03T18:57:12.318ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89692026-03-03T18:57:12.319ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89702026-03-03T18:57:12.322ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89712026-03-03T18:57:12.322ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89722026-03-03T18:57:12.322ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89732026-03-03T18:57:12.323ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89742026-03-03T18:57:12.324ZINFOtest_metrics (dropshot_external): request completed error_message_external = not found: silo with id "47174ca8-7062-4b5d-a8de-3ad573d1f493" error_message_internal = not found: silo with id "47174ca8-7062-4b5d-a8de-3ad573d1f493" latency_us = 27831 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = d64d588d-7dc6-437e-bc5a-064a7637d871 response_code = 404 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:12.296434043Z&order=descending&limit=1&silo=47174ca8-7062-4b5d-a8de-3ad573d1f493
89752026-03-03T18:57:12.325ZINFOtest_metrics (external client test context): client received response status = 404
89762026-03-03T18:57:12.325ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:37769/v1/instances?project=p-1
89772026-03-03T18:57:12.325ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 uri = /v1/instances?project=p-1
89782026-03-03T18:57:12.325ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 uri = /v1/instances?project=p-1 version = 2026021900.0.0
89792026-03-03T18:57:12.326ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 uri = /v1/instances?project=p-1
89802026-03-03T18:57:12.326ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/instances?project=p-1
89812026-03-03T18:57:12.326ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89822026-03-03T18:57:12.326ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89832026-03-03T18:57:12.326ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89842026-03-03T18:57:12.327ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89852026-03-03T18:57:12.328ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89862026-03-03T18:57:12.328ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89872026-03-03T18:57:12.330ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
89882026-03-03T18:57:12.330ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
89892026-03-03T18:57:12.330ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89902026-03-03T18:57:12.330ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89912026-03-03T18:57:12.330ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89922026-03-03T18:57:12.332ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
89932026-03-03T18:57:12.332ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89942026-03-03T18:57:12.332ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89952026-03-03T18:57:12.332ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89962026-03-03T18:57:12.334ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
89972026-03-03T18:57:12.342ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
89982026-03-03T18:57:12.342ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89992026-03-03T18:57:12.342ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
90002026-03-03T18:57:12.343ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
90012026-03-03T18:57:12.344ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
90022026-03-03T18:57:12.344ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
90032026-03-03T18:57:12.344ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
90042026-03-03T18:57:12.344ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
90052026-03-03T18:57:12.345ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
90062026-03-03T18:57:12.346ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
90072026-03-03T18:57:12.346ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
90082026-03-03T18:57:12.346ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
90092026-03-03T18:57:12.347ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
90102026-03-03T18:57:12.348ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
90112026-03-03T18:57:12.350ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
90122026-03-03T18:57:12.350ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 uri = /v1/instances?project=p-1
90132026-03-03T18:57:12.350ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90142026-03-03T18:57:12.350ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90152026-03-03T18:57:12.350ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90162026-03-03T18:57:12.350ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90172026-03-03T18:57:12.351ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90182026-03-03T18:57:12.354ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90192026-03-03T18:57:12.355ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90202026-03-03T18:57:12.355ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90212026-03-03T18:57:12.355ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90222026-03-03T18:57:12.356ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90232026-03-03T18:57:12.358ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90242026-03-03T18:57:12.358ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90252026-03-03T18:57:12.358ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90262026-03-03T18:57:12.360ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90272026-03-03T18:57:12.360ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90282026-03-03T18:57:12.360ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90292026-03-03T18:57:12.362ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90302026-03-03T18:57:12.362ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90312026-03-03T18:57:12.362ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90322026-03-03T18:57:12.362ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90332026-03-03T18:57:12.362ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90342026-03-03T18:57:12.364ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90352026-03-03T18:57:12.364ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90362026-03-03T18:57:12.364ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90372026-03-03T18:57:12.364ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90382026-03-03T18:57:12.367ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90392026-03-03T18:57:12.367ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90402026-03-03T18:57:12.367ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90412026-03-03T18:57:12.367ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90422026-03-03T18:57:12.369ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90432026-03-03T18:57:12.381ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90442026-03-03T18:57:12.382ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90452026-03-03T18:57:12.382ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90462026-03-03T18:57:12.382ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90472026-03-03T18:57:12.384ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90482026-03-03T18:57:12.384ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90492026-03-03T18:57:12.384ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90502026-03-03T18:57:12.386ZTRACtest_metrics (dropshot_external): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90512026-03-03T18:57:12.386ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90522026-03-03T18:57:12.386ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90532026-03-03T18:57:12.386ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90542026-03-03T18:57:12.386ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90552026-03-03T18:57:12.388ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90562026-03-03T18:57:12.388ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90572026-03-03T18:57:12.388ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90582026-03-03T18:57:12.388ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90592026-03-03T18:57:12.389ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
90602026-03-03T18:57:12.389ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
90612026-03-03T18:57:12.391ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90622026-03-03T18:57:12.392ZDEBGtest_metrics (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90632026-03-03T18:57:12.392ZTRACtest_metrics (dropshot_external): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90642026-03-03T18:57:12.393ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90652026-03-03T18:57:12.393ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90662026-03-03T18:57:12.393ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90672026-03-03T18:57:12.393ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90682026-03-03T18:57:12.395ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90692026-03-03T18:57:12.395ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90702026-03-03T18:57:12.395ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90712026-03-03T18:57:12.395ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90722026-03-03T18:57:12.397ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90732026-03-03T18:57:12.401ZDEBGtest_metrics (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90742026-03-03T18:57:12.401ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90752026-03-03T18:57:12.401ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90762026-03-03T18:57:12.401ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90772026-03-03T18:57:12.408ZTRACtest_metrics (dropshot_external): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90782026-03-03T18:57:12.408ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90792026-03-03T18:57:12.408ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90802026-03-03T18:57:12.408ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90812026-03-03T18:57:12.413ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90822026-03-03T18:57:12.426ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90832026-03-03T18:57:12.426ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90842026-03-03T18:57:12.426ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90852026-03-03T18:57:12.426ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90862026-03-03T18:57:12.428ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90872026-03-03T18:57:12.428ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90882026-03-03T18:57:12.428ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90892026-03-03T18:57:12.429ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90902026-03-03T18:57:12.431ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90912026-03-03T18:57:12.438ZDEBGtest_metrics (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90922026-03-03T18:57:12.438ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90932026-03-03T18:57:12.438ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90942026-03-03T18:57:12.438ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
90952026-03-03T18:57:12.443ZTRACtest_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet
90962026-03-03T18:57:12.448ZTRACtest_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
90972026-03-03T18:57:12.448ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
90982026-03-03T18:57:12.448ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
90992026-03-03T18:57:12.448ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
91002026-03-03T18:57:12.448ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
91012026-03-03T18:57:12.448ZDEBGtest_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
91022026-03-03T18:57:12.448ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
91032026-03-03T18:57:12.449ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
91042026-03-03T18:57:12.449ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
91052026-03-03T18:57:12.456ZINFOtest_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
91062026-03-03T18:57:12.464ZINFOtest_metrics (SagaExecutor): preparing saga saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create
91072026-03-03T18:57:12.464ZINFOtest_metrics (SEC): saga create dag = {"end_node":12,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[11,0,null],[10,12,null]],"node_holes":[],"nodes":[{"Constant":{"name":"instance_id","value":"bdb0e66e-b155-4e1a-9820-055b72e5342d"}},{"Action":{"action_name":"instance_create.create_instance_record","label":"CreateInstanceRecord","name":"instance_record"}},{"Action":{"action_name":"instance_create.associate_ssh_keys","label":"AssociateSshKeys","name":"output"}},{"Constant":{"name":"network_interface_params0","value":{"instance_id":"bdb0e66e-b155-4e1a-9820-055b72e5342d","instance_name":"i-1","interface_id":"a986e249-707c-4dbd-831e-0a9c2fb8f867","nic_spec":{"Default":"Ipv4"},"project_id":"47174ca8-7062-4b5d-a8de-3ad573d1f493","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},{"SubsagaStart":{"params_node_name":"network_interface_params0","saga_name":"instance-create-nic0"}},{"Action":{"action_name":"instance_create.create_network_interface","label":"CreateNetworkInterface0","name":"output"}},{"SubsagaEnd":{"name":"network_interface0"}},{"Action":{"action_name":"common.uuid_generate","label":"CreateSnatIpv4Id","name":"snat_ipv4_id"}},{"Action":{"action_name":"instance_create.create_snat_ipv4","label":"CreateSnatIpv4","name":"snat_ipv4"}},{"Action":{"action_name":"instance_create.set_boot_disk","label":"SetBootDisk","name":"set_boot_disk"}},{"Action":{"action_name":"instance_create.move_to_stopped","label":"MoveToStopped","name":"stopped_instance"}},{"Start":{"params":{"boundary_switches":[],"create_params":{"anti_affinity_groups":[],"auto_restart_policy":null,"boot_disk":null,"cpu_platform":null,"description":"instance \\"i-1\\"","disks":[],"external_ips":[],"hostname":"the-host","memory":1073741824,"multicast_groups":[],"name":"i-1","ncpus":4,"network_interfaces":{"type":"default_ipv4"},"ssh_public_keys":[],"start":true,"user_data":"I2Nsb3VkLWNvbmZpZwpzeXN0ZW1faW5mbzoKICBkZWZhdWx0X3VzZXI6CiAgICBuYW1lOiBveGlkZQ=="},"project_id":"47174ca8-7062-4b5d-a8de-3ad573d1f493","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"instance-create","start_node":11} saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
91082026-03-03T18:57:12.464ZINFOtest_metrics (SecStore): creating saga saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create
91092026-03-03T18:57:12.464ZINFOtest_metrics (SagaExecutor): starting saga saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create
91102026-03-03T18:57:12.464ZINFOtest_metrics (SEC): saga start saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
91112026-03-03T18:57:12.464ZDEBGtest_metrics (SEC): saga log event new_state = N011 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91122026-03-03T18:57:12.464ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
91132026-03-03T18:57:12.464ZDEBGtest_metrics (SEC): saga log event new_state = N011 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91142026-03-03T18:57:12.464ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
91152026-03-03T18:57:12.464ZDEBGtest_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91162026-03-03T18:57:12.464ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
91172026-03-03T18:57:12.465ZDEBGtest_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91182026-03-03T18:57:12.467ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("bdb0e66e-b155-4e1a-9820-055b72e5342d")) node_id = 0 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
91192026-03-03T18:57:12.467ZDEBGtest_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91202026-03-03T18:57:12.467ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
91212026-03-03T18:57:12.470ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91222026-03-03T18:57:12.473ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91232026-03-03T18:57:12.473ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91242026-03-03T18:57:12.473ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91252026-03-03T18:57:12.473ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91262026-03-03T18:57:12.473ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91272026-03-03T18:57:12.474ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91282026-03-03T18:57:12.474ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91292026-03-03T18:57:12.474ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91302026-03-03T18:57:12.474ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91312026-03-03T18:57:12.474ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91322026-03-03T18:57:12.477ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91332026-03-03T18:57:12.477ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91342026-03-03T18:57:12.477ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91352026-03-03T18:57:12.478ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91362026-03-03T18:57:12.482ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91372026-03-03T18:57:12.482ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91382026-03-03T18:57:12.483ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91392026-03-03T18:57:12.483ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91402026-03-03T18:57:12.485ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91412026-03-03T18:57:12.490ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91422026-03-03T18:57:12.491ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91432026-03-03T18:57:12.492ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91442026-03-03T18:57:12.492ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91452026-03-03T18:57:12.492ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91462026-03-03T18:57:12.492ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91472026-03-03T18:57:12.492ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
91482026-03-03T18:57:12.492ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
91492026-03-03T18:57:12.492ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91502026-03-03T18:57:12.492ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91512026-03-03T18:57:12.492ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91522026-03-03T18:57:12.493ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91532026-03-03T18:57:12.495ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91542026-03-03T18:57:12.495ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91552026-03-03T18:57:12.495ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91562026-03-03T18:57:12.495ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91572026-03-03T18:57:12.501ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91582026-03-03T18:57:12.505ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91592026-03-03T18:57:12.505ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91602026-03-03T18:57:12.505ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91612026-03-03T18:57:12.506ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91622026-03-03T18:57:12.518ZDEBGtest_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91632026-03-03T18:57:12.518ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"i-1\\""), "id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "name": String("i-1"), "time_created": String("2026-03-03T18:57:12.470542Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:12.470542Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(1), "migration_id": Null, "nexus_state": String("Creating"), "propolis_id": Null, "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T18:57:12.470542Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}) node_id = 1 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
91642026-03-03T18:57:12.521ZDEBGtest_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91652026-03-03T18:57:12.522ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
91662026-03-03T18:57:12.523ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91672026-03-03T18:57:12.523ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91682026-03-03T18:57:12.523ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91692026-03-03T18:57:12.524ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91702026-03-03T18:57:12.525ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91712026-03-03T18:57:12.525ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91722026-03-03T18:57:12.527ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91732026-03-03T18:57:12.527ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91742026-03-03T18:57:12.527ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91752026-03-03T18:57:12.527ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91762026-03-03T18:57:12.528ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91772026-03-03T18:57:12.530ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91782026-03-03T18:57:12.535ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91792026-03-03T18:57:12.535ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91802026-03-03T18:57:12.535ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91812026-03-03T18:57:12.535ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91822026-03-03T18:57:12.535ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91832026-03-03T18:57:12.535ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91842026-03-03T18:57:12.535ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91852026-03-03T18:57:12.535ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91862026-03-03T18:57:12.535ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91872026-03-03T18:57:12.535ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91882026-03-03T18:57:12.545ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91892026-03-03T18:57:12.545ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91902026-03-03T18:57:12.545ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91912026-03-03T18:57:12.545ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91922026-03-03T18:57:12.551ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91932026-03-03T18:57:12.553ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91942026-03-03T18:57:12.553ZDEBGtest_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91952026-03-03T18:57:12.553ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
91962026-03-03T18:57:12.555ZDEBGtest_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91972026-03-03T18:57:12.556ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
91982026-03-03T18:57:12.557ZDEBGtest_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91992026-03-03T18:57:12.557ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "instance_name": String("i-1"), "interface_id": String("a986e249-707c-4dbd-831e-0a9c2fb8f867"), "nic_spec": Object {"Default": String("Ipv4")}, "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}}) node_id = 3 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
92002026-03-03T18:57:12.559ZDEBGtest_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
92012026-03-03T18:57:12.559ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
92022026-03-03T18:57:12.562ZDEBGtest_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
92032026-03-03T18:57:12.562ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
92042026-03-03T18:57:12.564ZDEBGtest_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
92052026-03-03T18:57:12.564ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
92062026-03-03T18:57:12.566ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92072026-03-03T18:57:12.566ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92082026-03-03T18:57:12.567ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92092026-03-03T18:57:12.570ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92102026-03-03T18:57:12.570ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92112026-03-03T18:57:12.571ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92122026-03-03T18:57:12.572ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92132026-03-03T18:57:12.573ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92142026-03-03T18:57:12.573ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92152026-03-03T18:57:12.574ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92162026-03-03T18:57:12.574ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92172026-03-03T18:57:12.574ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92182026-03-03T18:57:12.574ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92192026-03-03T18:57:12.574ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92202026-03-03T18:57:12.576ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92212026-03-03T18:57:12.576ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92222026-03-03T18:57:12.576ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92232026-03-03T18:57:12.577ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92242026-03-03T18:57:12.581ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92252026-03-03T18:57:12.583ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92262026-03-03T18:57:12.583ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92272026-03-03T18:57:12.583ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92282026-03-03T18:57:12.584ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92292026-03-03T18:57:12.590ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92302026-03-03T18:57:12.591ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92312026-03-03T18:57:12.591ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92322026-03-03T18:57:12.591ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92332026-03-03T18:57:12.592ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
92342026-03-03T18:57:12.594ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92352026-03-03T18:57:12.594ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92362026-03-03T18:57:12.594ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92372026-03-03T18:57:12.600ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92382026-03-03T18:57:12.600ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92392026-03-03T18:57:12.600ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92402026-03-03T18:57:12.602ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92412026-03-03T18:57:12.602ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92422026-03-03T18:57:12.603ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92432026-03-03T18:57:12.611ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") }, key: 954cc302-beec-4b31-9846-5142d8600ee1, lookup_type: ByName("default") } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92442026-03-03T18:57:12.612ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92452026-03-03T18:57:12.612ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92462026-03-03T18:57:12.612ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92472026-03-03T18:57:12.612ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92482026-03-03T18:57:12.613ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92492026-03-03T18:57:12.613ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92502026-03-03T18:57:12.613ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92512026-03-03T18:57:12.614ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92522026-03-03T18:57:12.616ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92532026-03-03T18:57:12.616ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92542026-03-03T18:57:12.616ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92552026-03-03T18:57:12.617ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92562026-03-03T18:57:12.618ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92572026-03-03T18:57:12.627ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") }, key: 954cc302-beec-4b31-9846-5142d8600ee1, lookup_type: ByName("default") } result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92582026-03-03T18:57:12.627ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92592026-03-03T18:57:12.627ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92602026-03-03T18:57:12.627ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92612026-03-03T18:57:12.627ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92622026-03-03T18:57:12.628ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92632026-03-03T18:57:12.631ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92642026-03-03T18:57:12.631ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92652026-03-03T18:57:12.631ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92662026-03-03T18:57:12.631ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92672026-03-03T18:57:12.633ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92682026-03-03T18:57:12.633ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92692026-03-03T18:57:12.633ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92702026-03-03T18:57:12.634ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92712026-03-03T18:57:12.636ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92722026-03-03T18:57:12.641ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92732026-03-03T18:57:12.641ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") }, key: 954cc302-beec-4b31-9846-5142d8600ee1, lookup_type: ByName("default") } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92742026-03-03T18:57:12.641ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92752026-03-03T18:57:12.641ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92762026-03-03T18:57:12.641ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92772026-03-03T18:57:12.641ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92782026-03-03T18:57:12.650ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92792026-03-03T18:57:12.650ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92802026-03-03T18:57:12.650ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92812026-03-03T18:57:12.656ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92822026-03-03T18:57:12.656ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92832026-03-03T18:57:12.656ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92842026-03-03T18:57:12.656ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92852026-03-03T18:57:12.656ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92862026-03-03T18:57:12.656ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92872026-03-03T18:57:12.661ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") }, key: 954cc302-beec-4b31-9846-5142d8600ee1, lookup_type: ByName("default") } result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92882026-03-03T18:57:12.661ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92892026-03-03T18:57:12.661ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92902026-03-03T18:57:12.661ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92912026-03-03T18:57:12.746ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92922026-03-03T18:57:12.746ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92932026-03-03T18:57:12.747ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92942026-03-03T18:57:12.749ZDEBGtest_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
92952026-03-03T18:57:12.749ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
92962026-03-03T18:57:12.751ZDEBGtest_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
92972026-03-03T18:57:12.758ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
92982026-03-03T18:57:12.758ZDEBGtest_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
92992026-03-03T18:57:12.758ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
93002026-03-03T18:57:12.758ZDEBGtest_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
93012026-03-03T18:57:12.758ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
93022026-03-03T18:57:12.761ZDEBGtest_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
93032026-03-03T18:57:12.761ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("0b8a6e47-d41d-45e0-8095-77de465be0d2")) node_id = 7 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
93042026-03-03T18:57:12.762ZDEBGtest_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
93052026-03-03T18:57:12.762ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
93062026-03-03T18:57:12.763ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93072026-03-03T18:57:12.763ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93082026-03-03T18:57:12.764ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93092026-03-03T18:57:12.768ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93102026-03-03T18:57:12.769ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93112026-03-03T18:57:12.769ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93122026-03-03T18:57:12.782ZDEBGtest_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
93132026-03-03T18:57:12.782ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
93142026-03-03T18:57:12.784ZDEBGtest_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
93152026-03-03T18:57:12.784ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
93162026-03-03T18:57:12.786ZDEBGtest_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
93172026-03-03T18:57:12.786ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
93182026-03-03T18:57:12.787ZDEBGtest_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
93192026-03-03T18:57:12.787ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
93202026-03-03T18:57:12.793ZDEBGtest_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
93212026-03-03T18:57:12.794ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
93222026-03-03T18:57:12.794ZDEBGtest_metrics (SEC): saga log event new_state = N012 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
93232026-03-03T18:57:12.794ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
93242026-03-03T18:57:12.795ZDEBGtest_metrics (SEC): saga log event new_state = N012 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
93252026-03-03T18:57:12.796ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
93262026-03-03T18:57:12.797ZINFOtest_metrics (SEC): update for saga cached state new_state = Done saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 sec_id = 913233fe-92a8-4635-9572-183f495429c4
93272026-03-03T18:57:12.798ZINFOtest_metrics (SecStore): updating state new_state = done saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
93282026-03-03T18:57:12.799ZINFOtest_metrics (SEC): saga finished result = success saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
93292026-03-03T18:57:12.799ZINFOtest_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882
93302026-03-03T18:57:12.799ZINFOtest_metrics (SagaExecutor): saga finished saga_id = 7c341199-93e7-432b-ad82-2c1ae82b2882 saga_name = instance-create saga_result = SagaResult { saga_id: 7c341199-93e7-432b-ad82-2c1ae82b2882, saga_log: SagaLog { saga_id: 7c341199-93e7-432b-ad82-2c1ae82b2882, unwinding: false, events: [N011 started, N011 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N012 started, N012 succeeded], node_status: {0: Succeeded(String("bdb0e66e-b155-4e1a-9820-055b72e5342d")), 1: Succeeded(Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"i-1\\""), "id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "name": String("i-1"), "time_created": String("2026-03-03T18:57:12.470542Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:12.470542Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(1), "migration_id": Null, "nexus_state": String("Creating"), "propolis_id": Null, "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T18:57:12.470542Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}), 2: Succeeded(Null), 3: Succeeded(Object {"instance_id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "instance_name": String("i-1"), "interface_id": String("a986e249-707c-4dbd-831e-0a9c2fb8f867"), "nic_spec": Object {"Default": String("Ipv4")}, "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}}), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(String("0b8a6e47-d41d-45e0-8095-77de465be0d2")), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"instance_id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "instance_record": Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"i-1\\""), "id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "name": String("i-1"), "time_created": String("2026-03-03T18:57:12.470542Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:12.470542Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(1), "migration_id": Null, "nexus_state": String("Creating"), "propolis_id": Null, "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T18:57:12.470542Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}, "network_interface0": Null, "network_interface_params0": Object {"instance_id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "instance_name": String("i-1"), "interface_id": String("a986e249-707c-4dbd-831e-0a9c2fb8f867"), "nic_spec": Object {"Default": String("Ipv4")}, "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}}, "output": Null, "set_boot_disk": Null, "snat_ipv4": Null, "snat_ipv4_id": String("0b8a6e47-d41d-45e0-8095-77de465be0d2"), "stopped_instance": Null} }) }
93312026-03-03T18:57:12.799ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93322026-03-03T18:57:12.799ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93332026-03-03T18:57:12.800ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93342026-03-03T18:57:12.801ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93352026-03-03T18:57:12.803ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93362026-03-03T18:57:12.803ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93372026-03-03T18:57:12.803ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93382026-03-03T18:57:12.803ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93392026-03-03T18:57:12.803ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93402026-03-03T18:57:12.804ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93412026-03-03T18:57:12.804ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93422026-03-03T18:57:12.804ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93432026-03-03T18:57:12.804ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93442026-03-03T18:57:12.805ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93452026-03-03T18:57:12.806ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93462026-03-03T18:57:12.806ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93472026-03-03T18:57:12.806ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93482026-03-03T18:57:12.807ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93492026-03-03T18:57:12.809ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93502026-03-03T18:57:12.811ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93512026-03-03T18:57:12.811ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93522026-03-03T18:57:12.811ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93532026-03-03T18:57:12.811ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93542026-03-03T18:57:12.816ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93552026-03-03T18:57:12.816ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93562026-03-03T18:57:12.816ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93572026-03-03T18:57:12.816ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93582026-03-03T18:57:12.816ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93592026-03-03T18:57:12.816ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93602026-03-03T18:57:12.818ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93612026-03-03T18:57:12.818ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93622026-03-03T18:57:12.818ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93632026-03-03T18:57:12.819ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93642026-03-03T18:57:12.821ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93652026-03-03T18:57:12.822ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93662026-03-03T18:57:12.822ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93672026-03-03T18:57:12.822ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93682026-03-03T18:57:12.823ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93692026-03-03T18:57:12.828ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93702026-03-03T18:57:12.830ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93712026-03-03T18:57:12.830ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93722026-03-03T18:57:12.830ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93732026-03-03T18:57:12.831ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93742026-03-03T18:57:12.832ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93752026-03-03T18:57:12.832ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93762026-03-03T18:57:12.832ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93772026-03-03T18:57:12.832ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93782026-03-03T18:57:12.834ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93792026-03-03T18:57:12.834ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93802026-03-03T18:57:12.834ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93812026-03-03T18:57:12.834ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93822026-03-03T18:57:12.836ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93832026-03-03T18:57:12.836ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93842026-03-03T18:57:12.836ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93852026-03-03T18:57:12.837ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93862026-03-03T18:57:12.838ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93872026-03-03T18:57:12.843ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93882026-03-03T18:57:12.889ZINFOtest_metrics (dropshot_external): set intended instance state authenticated = true changed = false instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d intended_state = running local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
93892026-03-03T18:57:12.890ZINFOtest_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
93902026-03-03T18:57:12.890ZINFOtest_metrics (SagaExecutor): preparing saga saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start
93912026-03-03T18:57:12.890ZINFOtest_metrics (SEC): saga create dag = {"end_node":25,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[5,7,null],[5,8,null],[5,9,null],[5,10,null],[5,11,null],[5,12,null],[5,13,null],[5,14,null],[5,15,null],[5,16,null],[5,17,null],[6,18,null],[7,18,null],[8,18,null],[9,18,null],[10,18,null],[11,18,null],[12,18,null],[13,18,null],[14,18,null],[15,18,null],[16,18,null],[17,18,null],[18,19,null],[19,20,null],[20,21,null],[21,22,null],[22,23,null],[24,0,null],[23,25,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_start.generate_propolis_id","label":"GeneratePropolisId","name":"propolis_id"}},{"Action":{"action_name":"instance_start.alloc_server","label":"AllocServer","name":"sled_id"}},{"Action":{"action_name":"instance_start.alloc_propolis_ip","label":"AllocPropolisIp","name":"propolis_ip"}},{"Action":{"action_name":"instance_start.create_vmm_record","label":"CreateVmmRecord","name":"vmm_record"}},{"Action":{"action_name":"instance_start.mark_as_starting","label":"MarkAsStarting","name":"started_record"}},{"Action":{"action_name":"instance_start.list_local_storage","label":"ListLocalStorage","name":"local_storage_records"}},{"Action":{"action_name":"instance_start.ensure_local_storage_0","label":"EnsureLocalStorage_0","name":"ensure_local_storage_0"}},{"Action":{"action_name":"instance_start.ensure_local_storage_1","label":"EnsureLocalStorage_1","name":"ensure_local_storage_1"}},{"Action":{"action_name":"instance_start.ensure_local_storage_2","label":"EnsureLocalStorage_2","name":"ensure_local_storage_2"}},{"Action":{"action_name":"instance_start.ensure_local_storage_3","label":"EnsureLocalStorage_3","name":"ensure_local_storage_3"}},{"Action":{"action_name":"instance_start.ensure_local_storage_4","label":"EnsureLocalStorage_4","name":"ensure_local_storage_4"}},{"Action":{"action_name":"instance_start.ensure_local_storage_5","label":"EnsureLocalStorage_5","name":"ensure_local_storage_5"}},{"Action":{"action_name":"instance_start.ensure_local_storage_6","label":"EnsureLocalStorage_6","name":"ensure_local_storage_6"}},{"Action":{"action_name":"instance_start.ensure_local_storage_7","label":"EnsureLocalStorage_7","name":"ensure_local_storage_7"}},{"Action":{"action_name":"instance_start.ensure_local_storage_8","label":"EnsureLocalStorage_8","name":"ensure_local_storage_8"}},{"Action":{"action_name":"instance_start.ensure_local_storage_9","label":"EnsureLocalStorage_9","name":"ensure_local_storage_9"}},{"Action":{"action_name":"instance_start.ensure_local_storage_10","label":"EnsureLocalStorage_10","name":"ensure_local_storage_10"}},{"Action":{"action_name":"instance_start.ensure_local_storage_11","label":"EnsureLocalStorage_11","name":"ensure_local_storage_11"}},{"Action":{"action_name":"instance_start.dpd_ensure","label":"DpdEnsure","name":"dpd_ensure"}},{"Action":{"action_name":"instance_start.v2p_ensure","label":"V2PEnsure","name":"v2p_ensure"}},{"Action":{"action_name":"instance_start.ensure_registered","label":"EnsureRegistered","name":"ensure_registered"}},{"Action":{"action_name":"instance_start.update_multicast_sled_id","label":"UpdateMulticastSledId","name":"multicast_sled_id"}},{"Action":{"action_name":"instance_start.add_virtual_resources","label":"AddVirtualResources","name":"virtual_resources"}},{"Action":{"action_name":"instance_start.ensure_running","label":"EnsureRunning","name":"ensure_running"}},{"Start":{"params":{"db_instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":null,"cpu_platform":null,"hostname":"the-host","identity":{"description":"instance \\"i-1\\"","id":"bdb0e66e-b155-4e1a-9820-055b72e5342d","name":"i-1","time_created":"2026-03-03T18:57:12.470542Z","time_deleted":null,"time_modified":"2026-03-03T18:57:12.470542Z"},"intended_state":"Running","memory":1073741824,"ncpus":4,"project_id":"47174ca8-7062-4b5d-a8de-3ad573d1f493","runtime_state":{"dst_propolis_id":null,"gen":2,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2026-03-03T18:57:12.470542Z"},"updater_gen":1,"updater_id":null,"user_data":[35,99,108,111,117,100,45,99,111,110,102,105,103,10,115,121,115,116,101,109,95,105,110,102,111,58,10,32,32,100,101,102,97,117,108,116,95,117,115,101,114,58,10,32,32,32,32,110,97,109,101,58,32,111,120,105,100,101]},"reason":"AutoStart","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"instance-start","start_node":24} saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start sec_id = 913233fe-92a8-4635-9572-183f495429c4
93922026-03-03T18:57:12.890ZINFOtest_metrics (SecStore): creating saga saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start
93932026-03-03T18:57:12.892ZINFOtest_metrics (SagaExecutor): starting saga saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start
93942026-03-03T18:57:12.893ZINFOtest_metrics (SEC): saga start saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start sec_id = 913233fe-92a8-4635-9572-183f495429c4
93952026-03-03T18:57:12.893ZDEBGtest_metrics (SEC): saga log event new_state = N024 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
93962026-03-03T18:57:12.893ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 24 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
93972026-03-03T18:57:12.901ZDEBGtest_metrics (SEC): saga log event new_state = N024 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
93982026-03-03T18:57:12.901ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 24 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
93992026-03-03T18:57:12.907ZDEBGtest_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
94002026-03-03T18:57:12.908ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
94012026-03-03T18:57:12.910ZDEBGtest_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
94022026-03-03T18:57:12.912ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("1adc9c75-ecbb-4291-b532-10b2424fd31a")) node_id = 0 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
94032026-03-03T18:57:12.912ZDEBGtest_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
94042026-03-03T18:57:12.912ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
94052026-03-03T18:57:12.914ZINFOtest_metrics (InstanceAllocator): sled reservation starting instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d propolis_id = 1adc9c75-ecbb-4291-b532-10b2424fd31a query = sled_reservation
94062026-03-03T18:57:12.915ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
94072026-03-03T18:57:12.915ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
94082026-03-03T18:57:12.916ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
94092026-03-03T18:57:12.922ZINFOtest_metrics (InstanceAllocator): no attached local storage disks instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d propolis_id = 1adc9c75-ecbb-4291-b532-10b2424fd31a query = sled_reservation
94102026-03-03T18:57:12.931ZINFOtest_metrics (InstanceAllocator): sled targets: {b6d65341-167c-41df-9b5c-41cded99c229 (sled)} instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d propolis_id = 1adc9c75-ecbb-4291-b532-10b2424fd31a query = sled_reservation
94112026-03-03T18:57:12.931ZINFOtest_metrics (InstanceAllocator): local_storage_allocation_required: false instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d propolis_id = 1adc9c75-ecbb-4291-b532-10b2424fd31a query = sled_reservation
94122026-03-03T18:57:12.931ZINFOtest_metrics (InstanceAllocator): trying sled target b6d65341-167c-41df-9b5c-41cded99c229 instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d propolis_id = 1adc9c75-ecbb-4291-b532-10b2424fd31a query = sled_reservation
94132026-03-03T18:57:12.931ZINFOtest_metrics (InstanceAllocator): attempting to insert sled resource record instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d local_storage_required = false propolis_id = 1adc9c75-ecbb-4291-b532-10b2424fd31a query = sled_reservation
94142026-03-03T18:57:12.935ZINFOtest_metrics (InstanceAllocator): reservation succeeded! instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d propolis_id = 1adc9c75-ecbb-4291-b532-10b2424fd31a query = sled_reservation
94152026-03-03T18:57:12.936ZDEBGtest_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
94162026-03-03T18:57:12.936ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("b6d65341-167c-41df-9b5c-41cded99c229")) node_id = 1 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
94172026-03-03T18:57:12.939ZDEBGtest_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
94182026-03-03T18:57:12.939ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
94192026-03-03T18:57:12.941ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = AllocPropolisIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94202026-03-03T18:57:12.941ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = AllocPropolisIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94212026-03-03T18:57:12.942ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = AllocPropolisIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94222026-03-03T18:57:12.945ZDEBGtest_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
94232026-03-03T18:57:12.945ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("::1:0")) node_id = 2 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
94242026-03-03T18:57:12.947ZDEBGtest_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
94252026-03-03T18:57:12.947ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
94262026-03-03T18:57:12.949ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
94272026-03-03T18:57:12.949ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
94282026-03-03T18:57:12.949ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
94292026-03-03T18:57:12.958ZTRACtest_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
94302026-03-03T18:57:12.958ZTRACtest_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
94312026-03-03T18:57:12.958ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
94322026-03-03T18:57:12.958ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
94332026-03-03T18:57:12.959ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
94342026-03-03T18:57:12.960ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
94352026-03-03T18:57:12.964ZDEBGtest_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
94362026-03-03T18:57:12.964ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = CreateVmmRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94372026-03-03T18:57:12.964ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = CreateVmmRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94382026-03-03T18:57:12.964ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = CreateVmmRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94392026-03-03T18:57:13.010ZDEBGtest_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
94402026-03-03T18:57:13.010ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"cpu_platform": String("AmdMilan"), "id": String("1adc9c75-ecbb-4291-b532-10b2424fd31a"), "instance_id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(1), "state": String("Creating"), "time_state_updated": String("2026-03-03T18:57:12.964195Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T18:57:12.964195Z"), "time_deleted": Null}) node_id = 3 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
94412026-03-03T18:57:13.015ZDEBGtest_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
94422026-03-03T18:57:13.015ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
94432026-03-03T18:57:13.015ZINFOtest_metrics (SagaExecutor): moving instance to Starting state via saga instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d propolis_id = 1adc9c75-ecbb-4291-b532-10b2424fd31a saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start start_reason = AutoStart
94442026-03-03T18:57:13.015ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94452026-03-03T18:57:13.015ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94462026-03-03T18:57:13.015ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94472026-03-03T18:57:13.016ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94482026-03-03T18:57:13.016ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94492026-03-03T18:57:13.017ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94502026-03-03T18:57:13.018ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94512026-03-03T18:57:13.018ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94522026-03-03T18:57:13.019ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94532026-03-03T18:57:13.020ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94542026-03-03T18:57:13.020ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94552026-03-03T18:57:13.020ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94562026-03-03T18:57:13.020ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94572026-03-03T18:57:13.021ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94582026-03-03T18:57:13.023ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94592026-03-03T18:57:13.023ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94602026-03-03T18:57:13.023ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94612026-03-03T18:57:13.023ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94622026-03-03T18:57:13.026ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94632026-03-03T18:57:13.026ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94642026-03-03T18:57:13.026ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94652026-03-03T18:57:13.026ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94662026-03-03T18:57:13.028ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94672026-03-03T18:57:13.033ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94682026-03-03T18:57:13.033ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94692026-03-03T18:57:13.033ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94702026-03-03T18:57:13.033ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94712026-03-03T18:57:13.033ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94722026-03-03T18:57:13.033ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94732026-03-03T18:57:13.035ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94742026-03-03T18:57:13.035ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94752026-03-03T18:57:13.035ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94762026-03-03T18:57:13.036ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94772026-03-03T18:57:13.037ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94782026-03-03T18:57:13.037ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94792026-03-03T18:57:13.037ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94802026-03-03T18:57:13.038ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94812026-03-03T18:57:13.039ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94822026-03-03T18:57:13.044ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94832026-03-03T18:57:13.044ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94842026-03-03T18:57:13.044ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94852026-03-03T18:57:13.044ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94862026-03-03T18:57:13.052ZDEBGtest_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
94872026-03-03T18:57:13.052ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"i-1\\""), "id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "name": String("i-1"), "time_created": String("2026-03-03T18:57:12.470542Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:12.470542Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(3), "migration_id": Null, "nexus_state": String("Vmm"), "propolis_id": String("1adc9c75-ecbb-4291-b532-10b2424fd31a"), "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T18:57:12.470542Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}) node_id = 4 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
94882026-03-03T18:57:13.055ZDEBGtest_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
94892026-03-03T18:57:13.055ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
94902026-03-03T18:57:13.055ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
94912026-03-03T18:57:13.055ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
94922026-03-03T18:57:13.055ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
94932026-03-03T18:57:13.056ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
94942026-03-03T18:57:13.058ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94952026-03-03T18:57:13.058ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94962026-03-03T18:57:13.058ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94972026-03-03T18:57:13.060ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94982026-03-03T18:57:13.061ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94992026-03-03T18:57:13.061ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95002026-03-03T18:57:13.063ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
95012026-03-03T18:57:13.063ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
95022026-03-03T18:57:13.068ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95032026-03-03T18:57:13.068ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95042026-03-03T18:57:13.068ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95052026-03-03T18:57:13.070ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95062026-03-03T18:57:13.071ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95072026-03-03T18:57:13.071ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95082026-03-03T18:57:13.071ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95092026-03-03T18:57:13.072ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95102026-03-03T18:57:13.073ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
95112026-03-03T18:57:13.073ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
95122026-03-03T18:57:13.076ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95132026-03-03T18:57:13.076ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95142026-03-03T18:57:13.076ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95152026-03-03T18:57:13.076ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95162026-03-03T18:57:13.078ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95172026-03-03T18:57:13.078ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95182026-03-03T18:57:13.078ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95192026-03-03T18:57:13.079ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95202026-03-03T18:57:13.080ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95212026-03-03T18:57:13.085ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95222026-03-03T18:57:13.086ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95232026-03-03T18:57:13.086ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95242026-03-03T18:57:13.086ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95252026-03-03T18:57:13.087ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95262026-03-03T18:57:13.087ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95272026-03-03T18:57:13.087ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95282026-03-03T18:57:13.087ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95292026-03-03T18:57:13.087ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95302026-03-03T18:57:13.088ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95312026-03-03T18:57:13.089ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95322026-03-03T18:57:13.089ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95332026-03-03T18:57:13.089ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95342026-03-03T18:57:13.091ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95352026-03-03T18:57:13.091ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95362026-03-03T18:57:13.091ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95372026-03-03T18:57:13.091ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95382026-03-03T18:57:13.093ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95392026-03-03T18:57:13.098ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95402026-03-03T18:57:13.099ZDEBGtest_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95412026-03-03T18:57:13.100ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 5 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95422026-03-03T18:57:13.101ZDEBGtest_metrics (SEC): saga log event new_state = N017 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95432026-03-03T18:57:13.101ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 17 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95442026-03-03T18:57:13.103ZDEBGtest_metrics (SEC): saga log event new_state = N017 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95452026-03-03T18:57:13.103ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95462026-03-03T18:57:13.106ZDEBGtest_metrics (SEC): saga log event new_state = N016 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95472026-03-03T18:57:13.106ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 16 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95482026-03-03T18:57:13.108ZDEBGtest_metrics (SEC): saga log event new_state = N016 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95492026-03-03T18:57:13.108ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95502026-03-03T18:57:13.110ZDEBGtest_metrics (SEC): saga log event new_state = N015 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95512026-03-03T18:57:13.110ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 15 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95522026-03-03T18:57:13.112ZDEBGtest_metrics (SEC): saga log event new_state = N015 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95532026-03-03T18:57:13.112ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 15 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95542026-03-03T18:57:13.113ZDEBGtest_metrics (SEC): saga log event new_state = N014 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95552026-03-03T18:57:13.114ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 14 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95562026-03-03T18:57:13.115ZDEBGtest_metrics (SEC): saga log event new_state = N014 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95572026-03-03T18:57:13.115ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95582026-03-03T18:57:13.116ZDEBGtest_metrics (SEC): saga log event new_state = N013 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95592026-03-03T18:57:13.116ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 13 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95602026-03-03T18:57:13.117ZDEBGtest_metrics (SEC): saga log event new_state = N013 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95612026-03-03T18:57:13.117ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95622026-03-03T18:57:13.119ZDEBGtest_metrics (SEC): saga log event new_state = N012 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95632026-03-03T18:57:13.119ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 12 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95642026-03-03T18:57:13.121ZDEBGtest_metrics (SEC): saga log event new_state = N012 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95652026-03-03T18:57:13.121ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95662026-03-03T18:57:13.122ZDEBGtest_metrics (SEC): saga log event new_state = N011 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95672026-03-03T18:57:13.122ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 11 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95682026-03-03T18:57:13.123ZDEBGtest_metrics (SEC): saga log event new_state = N011 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95692026-03-03T18:57:13.123ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95702026-03-03T18:57:13.125ZDEBGtest_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95712026-03-03T18:57:13.125ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95722026-03-03T18:57:13.131ZDEBGtest_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95732026-03-03T18:57:13.131ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95742026-03-03T18:57:13.131ZDEBGtest_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95752026-03-03T18:57:13.131ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95762026-03-03T18:57:13.131ZDEBGtest_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95772026-03-03T18:57:13.131ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95782026-03-03T18:57:13.131ZDEBGtest_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95792026-03-03T18:57:13.131ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95802026-03-03T18:57:13.131ZDEBGtest_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95812026-03-03T18:57:13.131ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95822026-03-03T18:57:13.133ZDEBGtest_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95832026-03-03T18:57:13.133ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95842026-03-03T18:57:13.134ZDEBGtest_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95852026-03-03T18:57:13.135ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95862026-03-03T18:57:13.137ZDEBGtest_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95872026-03-03T18:57:13.137ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95882026-03-03T18:57:13.139ZDEBGtest_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95892026-03-03T18:57:13.139ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95902026-03-03T18:57:13.140ZDEBGtest_metrics (SEC): saga log event new_state = N018 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95912026-03-03T18:57:13.140ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 18 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
95922026-03-03T18:57:13.141ZINFOtest_metrics (SagaExecutor): start saga: ensuring instance dpd configuration instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start start_reason = AutoStart
95932026-03-03T18:57:13.141ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
95942026-03-03T18:57:13.141ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
95952026-03-03T18:57:13.142ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
95962026-03-03T18:57:13.143ZTRACtest_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
95972026-03-03T18:57:13.143ZTRACtest_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
95982026-03-03T18:57:13.143ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
95992026-03-03T18:57:13.143ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
96002026-03-03T18:57:13.144ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
96012026-03-03T18:57:13.145ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
96022026-03-03T18:57:13.148ZDEBGtest_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
96032026-03-03T18:57:13.148ZINFOtest_metrics (nexus): looking up instance's primary network interface instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d
96042026-03-03T18:57:13.148ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96052026-03-03T18:57:13.148ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96062026-03-03T18:57:13.149ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96072026-03-03T18:57:13.150ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96082026-03-03T18:57:13.150ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96092026-03-03T18:57:13.150ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96102026-03-03T18:57:13.151ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96112026-03-03T18:57:13.151ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96122026-03-03T18:57:13.152ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96132026-03-03T18:57:13.153ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96142026-03-03T18:57:13.153ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96152026-03-03T18:57:13.153ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96162026-03-03T18:57:13.153ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96172026-03-03T18:57:13.153ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96182026-03-03T18:57:13.159ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96192026-03-03T18:57:13.159ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96202026-03-03T18:57:13.159ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96212026-03-03T18:57:13.160ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96222026-03-03T18:57:13.161ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96232026-03-03T18:57:13.161ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96242026-03-03T18:57:13.162ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96252026-03-03T18:57:13.162ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96262026-03-03T18:57:13.164ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96272026-03-03T18:57:13.169ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96282026-03-03T18:57:13.169ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96292026-03-03T18:57:13.169ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96302026-03-03T18:57:13.169ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96312026-03-03T18:57:13.169ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96322026-03-03T18:57:13.169ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96332026-03-03T18:57:13.171ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96342026-03-03T18:57:13.171ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96352026-03-03T18:57:13.171ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96362026-03-03T18:57:13.171ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96372026-03-03T18:57:13.173ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96382026-03-03T18:57:13.173ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96392026-03-03T18:57:13.173ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96402026-03-03T18:57:13.173ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96412026-03-03T18:57:13.175ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96422026-03-03T18:57:13.180ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96432026-03-03T18:57:13.180ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96442026-03-03T18:57:13.180ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96452026-03-03T18:57:13.180ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96462026-03-03T18:57:13.184ZINFOtest_metrics (nexus): looking up instance's external IPs instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d
96472026-03-03T18:57:13.186ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96482026-03-03T18:57:13.186ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96492026-03-03T18:57:13.186ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96502026-03-03T18:57:13.187ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96512026-03-03T18:57:13.187ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96522026-03-03T18:57:13.187ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96532026-03-03T18:57:13.189ZTRACtest_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet
96542026-03-03T18:57:13.190ZTRACtest_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
96552026-03-03T18:57:13.190ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
96562026-03-03T18:57:13.190ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
96572026-03-03T18:57:13.190ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
96582026-03-03T18:57:13.191ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
96592026-03-03T18:57:13.193ZDEBGtest_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
96602026-03-03T18:57:13.193ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
96612026-03-03T18:57:13.193ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
96622026-03-03T18:57:13.193ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
96632026-03-03T18:57:13.194ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
96642026-03-03T18:57:13.194ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
96652026-03-03T18:57:13.195ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
96662026-03-03T18:57:13.195ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
96672026-03-03T18:57:13.195ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
96682026-03-03T18:57:13.195ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
96692026-03-03T18:57:13.195ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
96702026-03-03T18:57:13.196ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: c1 43 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .C..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:57021 req_id = 98a2d753-fc92-49e3-b707-0de47c1bc365
96712026-03-03T18:57:13.196ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 49475,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:57021 req_id = 98a2d753-fc92-49e3-b707-0de47c1bc365
96722026-03-03T18:57:13.196ZDEBGtest_metrics (store): query key key = _dendrite._tcp
96732026-03-03T18:57:13.196ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
96742026-03-03T18:57:13.196ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:57021 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 98a2d753-fc92-49e3-b707-0de47c1bc365
96752026-03-03T18:57:13.196ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1970, tv_nsec: 461591423 } })
96762026-03-03T18:57:13.197ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
96772026-03-03T18:57:13.197ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 06 0d 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:2440 req_id = 9d97d412-45d5-46de-b8ea-77fe65642f1c
96782026-03-03T18:57:13.197ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 1549,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:2440 req_id = 9d97d412-45d5-46de-b8ea-77fe65642f1c
96792026-03-03T18:57:13.197ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
96802026-03-03T18:57:13.197ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:2440 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 9d97d412-45d5-46de-b8ea-77fe65642f1c
96812026-03-03T18:57:13.218ZTRACtest_metrics (DpdClient): client request body = None method = GET uri = http://[::1]:34679/switch/identifiers
96822026-03-03T18:57:13.219ZTRACtest_metrics (DpdClient): client response result = Ok(Response { url: "http://[::1]:34679/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "672d6f95-8ff3-41df-bfd9-3e878ea8adc4", "content-length": "206", "date": "Tue, 03 Mar 2026 18:57:13 GMT"} })
96832026-03-03T18:57:13.221ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96842026-03-03T18:57:13.222ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96852026-03-03T18:57:13.223ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
96862026-03-03T18:57:13.276ZDEBGtest_metrics (nexus): no subnets attached to instance, nothing to notify Dendrite about instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d
96872026-03-03T18:57:13.276ZDEBGtest_metrics (SEC): saga log event new_state = N018 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
96882026-03-03T18:57:13.276ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
96892026-03-03T18:57:13.278ZDEBGtest_metrics (SEC): saga log event new_state = N019 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
96902026-03-03T18:57:13.278ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 19 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
96912026-03-03T18:57:13.280ZDEBGtest_metrics (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Signaled
96922026-03-03T18:57:13.280ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
96932026-03-03T18:57:13.280ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96942026-03-03T18:57:13.280ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
96952026-03-03T18:57:13.281ZDEBGtest_metrics (SEC): saga log event new_state = N019 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
96962026-03-03T18:57:13.281ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
96972026-03-03T18:57:13.282ZDEBGtest_metrics (SEC): saga log event new_state = N020 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
96982026-03-03T18:57:13.282ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 20 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
96992026-03-03T18:57:13.284ZINFOtest_metrics (SagaExecutor): start saga: ensuring instance is registered on sled instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_reason = AutoStart
97002026-03-03T18:57:13.284ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97012026-03-03T18:57:13.284ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97022026-03-03T18:57:13.285ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97032026-03-03T18:57:13.286ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97042026-03-03T18:57:13.286ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97052026-03-03T18:57:13.287ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97062026-03-03T18:57:13.287ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
97072026-03-03T18:57:13.287ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97082026-03-03T18:57:13.288ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
97092026-03-03T18:57:13.288ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97102026-03-03T18:57:13.288ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97112026-03-03T18:57:13.288ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97122026-03-03T18:57:13.290ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97132026-03-03T18:57:13.290ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97142026-03-03T18:57:13.290ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97152026-03-03T18:57:13.290ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97162026-03-03T18:57:13.290ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97172026-03-03T18:57:13.292ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97182026-03-03T18:57:13.292ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97192026-03-03T18:57:13.292ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97202026-03-03T18:57:13.292ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97212026-03-03T18:57:13.293ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
97222026-03-03T18:57:13.293ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
97232026-03-03T18:57:13.293ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
97242026-03-03T18:57:13.293ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97252026-03-03T18:57:13.293ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
97262026-03-03T18:57:13.294ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97272026-03-03T18:57:13.294ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97282026-03-03T18:57:13.294ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97292026-03-03T18:57:13.294ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97302026-03-03T18:57:13.295ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97312026-03-03T18:57:13.298ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97322026-03-03T18:57:13.298ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
97332026-03-03T18:57:13.298ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
97342026-03-03T18:57:13.298ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
97352026-03-03T18:57:13.298ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97362026-03-03T18:57:13.298ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
97372026-03-03T18:57:13.299ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97382026-03-03T18:57:13.303ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97392026-03-03T18:57:13.303ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97402026-03-03T18:57:13.304ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97412026-03-03T18:57:13.304ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97422026-03-03T18:57:13.304ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97432026-03-03T18:57:13.304ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97442026-03-03T18:57:13.305ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97452026-03-03T18:57:13.308ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97462026-03-03T18:57:13.308ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
97472026-03-03T18:57:13.308ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97482026-03-03T18:57:13.309ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
97492026-03-03T18:57:13.309ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97502026-03-03T18:57:13.309ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97512026-03-03T18:57:13.309ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97522026-03-03T18:57:13.310ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97532026-03-03T18:57:13.311ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97542026-03-03T18:57:13.311ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97552026-03-03T18:57:13.311ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97562026-03-03T18:57:13.312ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97572026-03-03T18:57:13.321ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = None method = GET uri = http://[::1]:36085/v2p
97582026-03-03T18:57:13.321ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35820 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
97592026-03-03T18:57:13.322ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = GET remote_addr = [::1]:35820 req_id = 08bafd3b-d62e-4fe3-87b8-c58d42a58bf7 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
97602026-03-03T18:57:13.322ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = GET remote_addr = [::1]:35820 req_id = 08bafd3b-d62e-4fe3-87b8-c58d42a58bf7 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p version = 23.0.0
97612026-03-03T18:57:13.322ZINFOtest_metrics (dropshot): request completed latency_us = 178 local_addr = [::1]:36085 method = GET remote_addr = [::1]:35820 req_id = 08bafd3b-d62e-4fe3-87b8-c58d42a58bf7 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
97622026-03-03T18:57:13.322ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:36085/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "08bafd3b-d62e-4fe3-87b8-c58d42a58bf7", "content-length": "2", "date": "Tue, 03 Mar 2026 18:57:13 GMT"} })
97632026-03-03T18:57:13.323ZINFOtest_metrics (BackgroundTasks): found opte v2p mappings background_task = v2p_manager interfaces = {} sled = SimGimlet00
97642026-03-03T18:57:13.323ZINFOtest_metrics (BackgroundTasks): v2p mappings to delete background_task = v2p_manager mappings = [] sled = SimGimlet00
97652026-03-03T18:57:13.323ZINFOtest_metrics (BackgroundTasks): v2p mappings to add background_task = v2p_manager mappings = [VirtualNetworkInterfaceHost { physical_host_ip: ::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(5991081) }] sled = SimGimlet00
97662026-03-03T18:57:13.323ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = Some(Body) method = PUT uri = http://[::1]:36085/v2p
97672026-03-03T18:57:13.323ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97682026-03-03T18:57:13.328ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97692026-03-03T18:57:13.328ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97702026-03-03T18:57:13.328ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97712026-03-03T18:57:13.328ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97722026-03-03T18:57:13.329ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35820 req_id = 5fa4dcbe-5e12-4910-8e26-efb4a3b2bf1c sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
97732026-03-03T18:57:13.329ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35820 req_id = 5fa4dcbe-5e12-4910-8e26-efb4a3b2bf1c sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p version = 23.0.0
97742026-03-03T18:57:13.329ZINFOtest_metrics (dropshot): request completed latency_us = 317 local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35820 req_id = 5fa4dcbe-5e12-4910-8e26-efb4a3b2bf1c response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
97752026-03-03T18:57:13.329ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97762026-03-03T18:57:13.329ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97772026-03-03T18:57:13.329ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97782026-03-03T18:57:13.329ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97792026-03-03T18:57:13.330ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97802026-03-03T18:57:13.330ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:36085/v2p", status: 204, headers: {"x-request-id": "5fa4dcbe-5e12-4910-8e26-efb4a3b2bf1c", "date": "Tue, 03 Mar 2026 18:57:13 GMT"} })
97812026-03-03T18:57:13.331ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 50.892991ms iteration = 2 status = {}
97822026-03-03T18:57:13.332ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97832026-03-03T18:57:13.332ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97842026-03-03T18:57:13.332ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97852026-03-03T18:57:13.332ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97862026-03-03T18:57:13.334ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97872026-03-03T18:57:13.334ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97882026-03-03T18:57:13.334ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97892026-03-03T18:57:13.334ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97902026-03-03T18:57:13.335ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97912026-03-03T18:57:13.340ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97922026-03-03T18:57:13.342ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97932026-03-03T18:57:13.342ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97942026-03-03T18:57:13.342ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97952026-03-03T18:57:13.342ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97962026-03-03T18:57:13.342ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97972026-03-03T18:57:13.344ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97982026-03-03T18:57:13.344ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
97992026-03-03T18:57:13.344ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98002026-03-03T18:57:13.344ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98012026-03-03T18:57:13.351ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98022026-03-03T18:57:13.351ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98032026-03-03T18:57:13.351ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98042026-03-03T18:57:13.351ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98052026-03-03T18:57:13.353ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98062026-03-03T18:57:13.358ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98072026-03-03T18:57:13.361ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98082026-03-03T18:57:13.361ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98092026-03-03T18:57:13.362ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98102026-03-03T18:57:13.362ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98112026-03-03T18:57:13.362ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98122026-03-03T18:57:13.362ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98132026-03-03T18:57:13.363ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98142026-03-03T18:57:13.363ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98152026-03-03T18:57:13.363ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98162026-03-03T18:57:13.365ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98172026-03-03T18:57:13.365ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98182026-03-03T18:57:13.365ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98192026-03-03T18:57:13.366ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98202026-03-03T18:57:13.366ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98212026-03-03T18:57:13.367ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98222026-03-03T18:57:13.368ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98232026-03-03T18:57:13.368ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98242026-03-03T18:57:13.368ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98252026-03-03T18:57:13.372ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98262026-03-03T18:57:13.372ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98272026-03-03T18:57:13.372ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98282026-03-03T18:57:13.372ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98292026-03-03T18:57:13.373ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98302026-03-03T18:57:13.377ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98312026-03-03T18:57:13.380ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98322026-03-03T18:57:13.380ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98332026-03-03T18:57:13.380ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98342026-03-03T18:57:13.380ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98352026-03-03T18:57:13.380ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98362026-03-03T18:57:13.380ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98372026-03-03T18:57:13.380ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98382026-03-03T18:57:13.381ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98392026-03-03T18:57:13.386ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98402026-03-03T18:57:13.386ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98412026-03-03T18:57:13.387ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98422026-03-03T18:57:13.387ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98432026-03-03T18:57:13.387ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98442026-03-03T18:57:13.387ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98452026-03-03T18:57:13.388ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98462026-03-03T18:57:13.389ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98472026-03-03T18:57:13.389ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98482026-03-03T18:57:13.389ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98492026-03-03T18:57:13.390ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98502026-03-03T18:57:13.390ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98512026-03-03T18:57:13.390ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98522026-03-03T18:57:13.391ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98532026-03-03T18:57:13.392ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98542026-03-03T18:57:13.397ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98552026-03-03T18:57:13.397ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98562026-03-03T18:57:13.397ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98572026-03-03T18:57:13.398ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98582026-03-03T18:57:13.402ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98592026-03-03T18:57:13.402ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98602026-03-03T18:57:13.403ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98612026-03-03T18:57:13.405ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98622026-03-03T18:57:13.405ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98632026-03-03T18:57:13.405ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98642026-03-03T18:57:13.407ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98652026-03-03T18:57:13.407ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98662026-03-03T18:57:13.407ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98672026-03-03T18:57:13.427ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98682026-03-03T18:57:13.427ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98692026-03-03T18:57:13.427ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98702026-03-03T18:57:13.427ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98712026-03-03T18:57:13.427ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98722026-03-03T18:57:13.433ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98732026-03-03T18:57:13.433ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98742026-03-03T18:57:13.433ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98752026-03-03T18:57:13.434ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98762026-03-03T18:57:13.436ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98772026-03-03T18:57:13.436ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98782026-03-03T18:57:13.436ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98792026-03-03T18:57:13.436ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98802026-03-03T18:57:13.439ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98812026-03-03T18:57:13.444ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98822026-03-03T18:57:13.444ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98832026-03-03T18:57:13.444ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98842026-03-03T18:57:13.444ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98852026-03-03T18:57:13.444ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98862026-03-03T18:57:13.444ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98872026-03-03T18:57:13.446ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98882026-03-03T18:57:13.446ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98892026-03-03T18:57:13.446ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98902026-03-03T18:57:13.447ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98912026-03-03T18:57:13.448ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98922026-03-03T18:57:13.448ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98932026-03-03T18:57:13.448ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98942026-03-03T18:57:13.449ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98952026-03-03T18:57:13.450ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98962026-03-03T18:57:13.455ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ByName("default") } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98972026-03-03T18:57:13.456ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98982026-03-03T18:57:13.456ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98992026-03-03T18:57:13.456ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99002026-03-03T18:57:13.459ZDEBGtest_metrics (nexus): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {Name("default"): [NetworkInterface { id: a986e249-707c-4dbd-831e-0a9c2fb8f867, kind: Instance { id: bdb0e66e-b155-4e1a-9820-055b72e5342d }, name: Name("net0"), ip_config: V4(PrivateIpv4Config { ip: 172.30.0.5, subnet: Ipv4Net { addr: 172.30.0.0, width: 22 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(5991081), primary: true, slot: 0 }]}
99012026-03-03T18:57:13.460ZDEBGtest_metrics (nexus): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a986e249-707c-4dbd-831e-0a9c2fb8f867, kind: Instance { id: bdb0e66e-b155-4e1a-9820-055b72e5342d }, name: Name("net0"), ip_config: V4(PrivateIpv4Config { ip: 172.30.0.5, subnet: Ipv4Net { addr: 172.30.0.0, width: 22 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(5991081), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(None)]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a986e249-707c-4dbd-831e-0a9c2fb8f867, kind: Instance { id: bdb0e66e-b155-4e1a-9820-055b72e5342d }, name: Name("net0"), ip_config: V4(PrivateIpv4Config { ip: 172.30.0.5, subnet: Ipv4Net { addr: 172.30.0.0, width: 22 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(5991081), primary: true, slot: 0 }], filter_hosts: Some({Vpc(Vni(5991081))}), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a986e249-707c-4dbd-831e-0a9c2fb8f867, kind: Instance { id: bdb0e66e-b155-4e1a-9820-055b72e5342d }, name: Name("net0"), ip_config: V4(PrivateIpv4Config { ip: 172.30.0.5, subnet: Ipv4Net { addr: 172.30.0.0, width: 22 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(5991081), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
99022026-03-03T18:57:13.460ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99032026-03-03T18:57:13.460ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99042026-03-03T18:57:13.460ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99052026-03-03T18:57:13.464ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99062026-03-03T18:57:13.464ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99072026-03-03T18:57:13.465ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99082026-03-03T18:57:13.467ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99092026-03-03T18:57:13.467ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99102026-03-03T18:57:13.467ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99112026-03-03T18:57:13.467ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99122026-03-03T18:57:13.467ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99132026-03-03T18:57:13.470ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99142026-03-03T18:57:13.470ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99152026-03-03T18:57:13.470ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99162026-03-03T18:57:13.471ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99172026-03-03T18:57:13.472ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99182026-03-03T18:57:13.472ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99192026-03-03T18:57:13.472ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99202026-03-03T18:57:13.473ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99212026-03-03T18:57:13.474ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99222026-03-03T18:57:13.479ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99232026-03-03T18:57:13.480ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99242026-03-03T18:57:13.480ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99252026-03-03T18:57:13.480ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99262026-03-03T18:57:13.491ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
99272026-03-03T18:57:13.491ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
99282026-03-03T18:57:13.492ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
99292026-03-03T18:57:13.495ZTRACtest_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
99302026-03-03T18:57:13.495ZTRACtest_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
99312026-03-03T18:57:13.495ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
99322026-03-03T18:57:13.495ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
99332026-03-03T18:57:13.496ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
99342026-03-03T18:57:13.497ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
99352026-03-03T18:57:13.501ZDEBGtest_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
99362026-03-03T18:57:13.501ZDEBGtest_metrics (nexus): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 body = Some(Body) method = PUT uri = http://[::1]:36085/vmms/1adc9c75-ecbb-4291-b532-10b2424fd31a
99372026-03-03T18:57:13.502ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35822 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
99382026-03-03T18:57:13.502ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35822 req_id = 397313e7-916f-4e56-9379-e5e92c097ab6 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/1adc9c75-ecbb-4291-b532-10b2424fd31a
99392026-03-03T18:57:13.502ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35822 req_id = 397313e7-916f-4e56-9379-e5e92c097ab6 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/1adc9c75-ecbb-4291-b532-10b2424fd31a version = 23.0.0
99402026-03-03T18:57:13.503ZINFOtest_metrics (SledAgent): created id = 1adc9c75-ecbb-4291-b532-10b2424fd31a initial_state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, generation: Generation(2), time_updated: 2026-03-03T18:57:13.501081092Z }, migration_in: None, migration_out: None } kind = instances server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
99412026-03-03T18:57:13.504ZINFOtest_metrics (dropshot): request completed latency_us = 1609 local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35822 req_id = 397313e7-916f-4e56-9379-e5e92c097ab6 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/1adc9c75-ecbb-4291-b532-10b2424fd31a
99422026-03-03T18:57:13.504ZDEBGtest_metrics (nexus): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 result = Ok(Response { url: "http://[::1]:36085/vmms/1adc9c75-ecbb-4291-b532-10b2424fd31a", status: 200, headers: {"content-type": "application/json", "x-request-id": "397313e7-916f-4e56-9379-e5e92c097ab6", "content-length": "131", "date": "Tue, 03 Mar 2026 18:57:13 GMT"} })
99432026-03-03T18:57:13.504ZINFOtest_metrics (SagaExecutor): received new VMM runtime state from sled agent authenticated = true migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 1adc9c75-ecbb-4291-b532-10b2424fd31a saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user vmm_state = VmmRuntimeState { state: Starting, generation: Generation(2), time_updated: 2026-03-03T18:57:13.501081092Z }
99442026-03-03T18:57:13.504ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99452026-03-03T18:57:13.504ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99462026-03-03T18:57:13.504ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99472026-03-03T18:57:13.532ZDEBGtest_metrics (SEC): saga log event new_state = N020 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
99482026-03-03T18:57:13.532ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"cpu_platform": String("AmdMilan"), "id": String("1adc9c75-ecbb-4291-b532-10b2424fd31a"), "instance_id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(2), "state": String("Starting"), "time_state_updated": String("2026-03-03T18:57:13.501081092Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T18:57:12.964195Z"), "time_deleted": Null}) node_id = 20 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
99492026-03-03T18:57:13.534ZDEBGtest_metrics (SEC): saga log event new_state = N021 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
99502026-03-03T18:57:13.534ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 21 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
99512026-03-03T18:57:13.536ZINFOtest_metrics (SagaExecutor): start saga: updating multicast member sled_id instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_reason = AutoStart
99522026-03-03T18:57:13.536ZDEBGtest_metrics (SagaExecutor): multicast member lifecycle transition: updating sled_id authenticated = true instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d new_sled_id = Some(b6d65341-167c-41df-9b5c-41cded99c229 (sled)) operation = instance_start_or_migrate saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = UpdateMulticastSledId silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99532026-03-03T18:57:13.536ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = UpdateMulticastSledId silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99542026-03-03T18:57:13.536ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = UpdateMulticastSledId silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99552026-03-03T18:57:13.537ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = UpdateMulticastSledId silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99562026-03-03T18:57:13.539ZDEBGtest_metrics (SEC): saga log event new_state = N021 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
99572026-03-03T18:57:13.539ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 21 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
99582026-03-03T18:57:13.540ZDEBGtest_metrics (SEC): saga log event new_state = N022 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
99592026-03-03T18:57:13.540ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 22 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
99602026-03-03T18:57:13.542ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = AddVirtualResources silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99612026-03-03T18:57:13.542ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = AddVirtualResources silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99622026-03-03T18:57:13.542ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = AddVirtualResources silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99632026-03-03T18:57:13.548ZDEBGtest_metrics (SEC): saga log event new_state = N022 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
99642026-03-03T18:57:13.548ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 22 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
99652026-03-03T18:57:13.549ZDEBGtest_metrics (SEC): saga log event new_state = N023 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
99662026-03-03T18:57:13.549ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 23 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
99672026-03-03T18:57:13.551ZINFOtest_metrics (SagaExecutor): start saga: ensuring instance is running instance_id = bdb0e66e-b155-4e1a-9820-055b72e5342d saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_reason = AutoStart
99682026-03-03T18:57:13.559ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
99692026-03-03T18:57:13.559ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
99702026-03-03T18:57:13.560ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
99712026-03-03T18:57:13.561ZTRACtest_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
99722026-03-03T18:57:13.561ZTRACtest_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
99732026-03-03T18:57:13.561ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
99742026-03-03T18:57:13.561ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
99752026-03-03T18:57:13.562ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
99762026-03-03T18:57:13.563ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
99772026-03-03T18:57:13.566ZDEBGtest_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
99782026-03-03T18:57:13.566ZDEBGtest_metrics (nexus): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 body = Some(Body) method = PUT uri = http://[::1]:36085/vmms/1adc9c75-ecbb-4291-b532-10b2424fd31a/state
99792026-03-03T18:57:13.567ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35824 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
99802026-03-03T18:57:13.567ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35824 req_id = 9dacdfbe-a81b-485c-8196-872a34e8ae81 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/1adc9c75-ecbb-4291-b532-10b2424fd31a/state
99812026-03-03T18:57:13.567ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35824 req_id = 9dacdfbe-a81b-485c-8196-872a34e8ae81 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/1adc9c75-ecbb-4291-b532-10b2424fd31a/state version = 23.0.0
99822026-03-03T18:57:13.567ZINFOtest_metrics (SledAgent): noop transition id = 1adc9c75-ecbb-4291-b532-10b2424fd31a kind = instances server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 target = Running
99832026-03-03T18:57:13.567ZINFOtest_metrics (dropshot): request completed latency_us = 356 local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35824 req_id = 9dacdfbe-a81b-485c-8196-872a34e8ae81 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/1adc9c75-ecbb-4291-b532-10b2424fd31a/state
99842026-03-03T18:57:13.568ZDEBGtest_metrics (nexus): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 result = Ok(Response { url: "http://[::1]:36085/vmms/1adc9c75-ecbb-4291-b532-10b2424fd31a/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dacdfbe-a81b-485c-8196-872a34e8ae81", "content-length": "151", "date": "Tue, 03 Mar 2026 18:57:13 GMT"} })
99852026-03-03T18:57:13.568ZINFOtest_metrics (SagaExecutor): received new VMM runtime state from sled agent authenticated = true migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 1adc9c75-ecbb-4291-b532-10b2424fd31a saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRunning silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user vmm_state = VmmRuntimeState { state: Starting, generation: Generation(2), time_updated: 2026-03-03T18:57:13.501081092Z }
99862026-03-03T18:57:13.568ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRunning silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99872026-03-03T18:57:13.568ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRunning silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99882026-03-03T18:57:13.568ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_node = EnsureRunning silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99892026-03-03T18:57:13.571ZDEBGtest_metrics (SEC): saga log event new_state = N023 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
99902026-03-03T18:57:13.571ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 23 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
99912026-03-03T18:57:13.572ZDEBGtest_metrics (SEC): saga log event new_state = N025 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
99922026-03-03T18:57:13.572ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 25 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
99932026-03-03T18:57:13.574ZDEBGtest_metrics (SEC): saga log event new_state = N025 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
99942026-03-03T18:57:13.574ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 25 saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
99952026-03-03T18:57:13.575ZINFOtest_metrics (SEC): update for saga cached state new_state = Done saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece sec_id = 913233fe-92a8-4635-9572-183f495429c4
99962026-03-03T18:57:13.575ZINFOtest_metrics (SecStore): updating state new_state = done saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
99972026-03-03T18:57:13.578ZINFOtest_metrics (SEC): saga finished result = success saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start sec_id = 913233fe-92a8-4635-9572-183f495429c4
99982026-03-03T18:57:13.578ZINFOtest_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece
99992026-03-03T18:57:13.578ZINFOtest_metrics (SagaExecutor): saga finished saga_id = bf6d3983-8a7e-483b-b104-75bc1e203ece saga_name = instance-start saga_result = SagaResult { saga_id: bf6d3983-8a7e-483b-b104-75bc1e203ece, saga_log: SagaLog { saga_id: bf6d3983-8a7e-483b-b104-75bc1e203ece, unwinding: false, events: [N024 started, N024 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N017 started, N017 succeeded, N016 started, N016 succeeded, N015 started, N015 succeeded, N014 started, N014 succeeded, N013 started, N013 succeeded, N012 started, N012 succeeded, N011 started, N011 succeeded, N010 started, N010 succeeded, N009 started, N009 succeeded, N008 started, N008 succeeded, N007 started, N007 succeeded, N006 started, N006 succeeded, N018 started, N018 succeeded, N019 started, N019 succeeded, N020 started, N020 succeeded, N021 started, N021 succeeded, N022 started, N022 succeeded, N023 started, N023 succeeded, N025 started, N025 succeeded], node_status: {0: Succeeded(String("1adc9c75-ecbb-4291-b532-10b2424fd31a")), 1: Succeeded(String("b6d65341-167c-41df-9b5c-41cded99c229")), 2: Succeeded(String("::1:0")), 3: Succeeded(Object {"cpu_platform": String("AmdMilan"), "id": String("1adc9c75-ecbb-4291-b532-10b2424fd31a"), "instance_id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(1), "state": String("Creating"), "time_state_updated": String("2026-03-03T18:57:12.964195Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T18:57:12.964195Z"), "time_deleted": Null}), 4: Succeeded(Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"i-1\\""), "id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "name": String("i-1"), "time_created": String("2026-03-03T18:57:12.470542Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:12.470542Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(3), "migration_id": Null, "nexus_state": String("Vmm"), "propolis_id": String("1adc9c75-ecbb-4291-b532-10b2424fd31a"), "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T18:57:12.470542Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}), 5: Succeeded(Array []), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null), 15: Succeeded(Null), 16: Succeeded(Null), 17: Succeeded(Null), 18: Succeeded(Null), 19: Succeeded(Null), 20: Succeeded(Object {"cpu_platform": String("AmdMilan"), "id": String("1adc9c75-ecbb-4291-b532-10b2424fd31a"), "instance_id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(2), "state": String("Starting"), "time_state_updated": String("2026-03-03T18:57:13.501081092Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T18:57:12.964195Z"), "time_deleted": Null}), 21: Succeeded(Null), 22: Succeeded(Null), 23: Succeeded(Null), 24: Succeeded(Null), 25: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"dpd_ensure": Null, "ensure_local_storage_0": Null, "ensure_local_storage_1": Null, "ensure_local_storage_10": Null, "ensure_local_storage_11": Null, "ensure_local_storage_2": Null, "ensure_local_storage_3": Null, "ensure_local_storage_4": Null, "ensure_local_storage_5": Null, "ensure_local_storage_6": Null, "ensure_local_storage_7": Null, "ensure_local_storage_8": Null, "ensure_local_storage_9": Null, "ensure_registered": Object {"cpu_platform": String("AmdMilan"), "id": String("1adc9c75-ecbb-4291-b532-10b2424fd31a"), "instance_id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(2), "state": String("Starting"), "time_state_updated": String("2026-03-03T18:57:13.501081092Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T18:57:12.964195Z"), "time_deleted": Null}, "ensure_running": Null, "local_storage_records": Array [], "multicast_sled_id": Null, "propolis_id": String("1adc9c75-ecbb-4291-b532-10b2424fd31a"), "propolis_ip": String("::1:0"), "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "started_record": Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"i-1\\""), "id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "name": String("i-1"), "time_created": String("2026-03-03T18:57:12.470542Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:12.470542Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(3), "migration_id": Null, "nexus_state": String("Vmm"), "propolis_id": String("1adc9c75-ecbb-4291-b532-10b2424fd31a"), "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T18:57:12.470542Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}, "v2p_ensure": Null, "virtual_resources": Null, "vmm_record": Object {"cpu_platform": String("AmdMilan"), "id": String("1adc9c75-ecbb-4291-b532-10b2424fd31a"), "instance_id": String("bdb0e66e-b155-4e1a-9820-055b72e5342d"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(1), "state": String("Creating"), "time_state_updated": String("2026-03-03T18:57:12.964195Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T18:57:12.964195Z"), "time_deleted": Null}} }) }
100002026-03-03T18:57:13.578ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100012026-03-03T18:57:13.578ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100022026-03-03T18:57:13.578ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100032026-03-03T18:57:13.578ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100042026-03-03T18:57:13.578ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100052026-03-03T18:57:13.579ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 8 reason = Signaled
100062026-03-03T18:57:13.579ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
100072026-03-03T18:57:13.579ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
100082026-03-03T18:57:13.579ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
100092026-03-03T18:57:13.579ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 3f 7f 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ?............_de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:44529 req_id = 574dc736-aa2c-431a-8857-5816c92b40ee
100102026-03-03T18:57:13.580ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 16255,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:44529 req_id = 574dc736-aa2c-431a-8857-5816c92b40ee
100112026-03-03T18:57:13.580ZDEBGtest_metrics (store): query key key = _dendrite._tcp
100122026-03-03T18:57:13.580ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
100132026-03-03T18:57:13.580ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:44529 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 574dc736-aa2c-431a-8857-5816c92b40ee
100142026-03-03T18:57:13.580ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1970, tv_nsec: 845172177 } })
100152026-03-03T18:57:13.580ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
100162026-03-03T18:57:13.580ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: b1 db 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:13156 req_id = 36bf300b-e824-4fff-9eb0-22e7e0d07bb6
100172026-03-03T18:57:13.580ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 45531,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:13156 req_id = 36bf300b-e824-4fff-9eb0-22e7e0d07bb6
100182026-03-03T18:57:13.580ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
100192026-03-03T18:57:13.580ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:13156 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 36bf300b-e824-4fff-9eb0-22e7e0d07bb6
100202026-03-03T18:57:13.599ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:34679/switch/identifiers
100212026-03-03T18:57:13.599ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100222026-03-03T18:57:13.599ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100232026-03-03T18:57:13.599ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100242026-03-03T18:57:13.600ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100252026-03-03T18:57:13.601ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:34679/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ae2bb6d-ce64-42a9-8397-ee9d92552efb", "content-length": "206", "date": "Tue, 03 Mar 2026 18:57:13 GMT"} })
100262026-03-03T18:57:13.601ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
100272026-03-03T18:57:13.601ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
100282026-03-03T18:57:13.601ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
100292026-03-03T18:57:13.602ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
100302026-03-03T18:57:13.602ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100312026-03-03T18:57:13.602ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100322026-03-03T18:57:13.602ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100332026-03-03T18:57:13.602ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100342026-03-03T18:57:13.604ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
100352026-03-03T18:57:13.604ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
100362026-03-03T18:57:13.604ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
100372026-03-03T18:57:13.604ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
100382026-03-03T18:57:13.604ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
100392026-03-03T18:57:13.604ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100402026-03-03T18:57:13.609ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100412026-03-03T18:57:13.611ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100422026-03-03T18:57:13.611ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100432026-03-03T18:57:13.611ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100442026-03-03T18:57:13.611ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
100452026-03-03T18:57:13.611ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
100462026-03-03T18:57:13.611ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
100472026-03-03T18:57:13.611ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
100482026-03-03T18:57:13.612ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
100492026-03-03T18:57:13.613ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100502026-03-03T18:57:13.613ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100512026-03-03T18:57:13.613ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100522026-03-03T18:57:13.613ZDEBGtest_metrics (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Signaled
100532026-03-03T18:57:13.613ZINFOtest_metrics (BackgroundTasks): VPC route manager running background_task = vpc_route_manager
100542026-03-03T18:57:13.613ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
100552026-03-03T18:57:13.613ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
100562026-03-03T18:57:13.613ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
100572026-03-03T18:57:13.613ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100582026-03-03T18:57:13.613ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100592026-03-03T18:57:13.614ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
100602026-03-03T18:57:13.615ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
100612026-03-03T18:57:13.615ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
100622026-03-03T18:57:13.615ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
100632026-03-03T18:57:13.615ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
100642026-03-03T18:57:13.615ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100652026-03-03T18:57:13.615ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100662026-03-03T18:57:13.615ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100672026-03-03T18:57:13.615ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100682026-03-03T18:57:13.618ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100692026-03-03T18:57:13.618ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
100702026-03-03T18:57:13.618ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
100712026-03-03T18:57:13.618ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
100722026-03-03T18:57:13.618ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100732026-03-03T18:57:13.618ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100742026-03-03T18:57:13.619ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100752026-03-03T18:57:13.620ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100762026-03-03T18:57:13.620ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100772026-03-03T18:57:13.620ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
100782026-03-03T18:57:13.620ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
100792026-03-03T18:57:13.620ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
100802026-03-03T18:57:13.621ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
100812026-03-03T18:57:13.621ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100822026-03-03T18:57:13.624ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100832026-03-03T18:57:13.624ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
100842026-03-03T18:57:13.624ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100852026-03-03T18:57:13.624ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100862026-03-03T18:57:13.629ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100872026-03-03T18:57:13.629ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100882026-03-03T18:57:13.629ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100892026-03-03T18:57:13.629ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100902026-03-03T18:57:13.629ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
100912026-03-03T18:57:13.629ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
100922026-03-03T18:57:13.629ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
100932026-03-03T18:57:13.629ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
100942026-03-03T18:57:13.629ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
100952026-03-03T18:57:13.629ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
100962026-03-03T18:57:13.635ZINFOtest_metrics (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager
100972026-03-03T18:57:13.637ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = None method = GET uri = http://[::1]:36085/vpc-routes
100982026-03-03T18:57:13.637ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:36085 remote_addr = [::1]:35826 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
100992026-03-03T18:57:13.637ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = GET remote_addr = [::1]:35826 req_id = 8c4207cc-ee7f-418d-b3e0-a351697bf3cc sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
101002026-03-03T18:57:13.637ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = GET remote_addr = [::1]:35826 req_id = 8c4207cc-ee7f-418d-b3e0-a351697bf3cc sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
101012026-03-03T18:57:13.637ZINFOtest_metrics (dropshot): request completed latency_us = 193 local_addr = [::1]:36085 method = GET remote_addr = [::1]:35826 req_id = 8c4207cc-ee7f-418d-b3e0-a351697bf3cc response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
101022026-03-03T18:57:13.637ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
101032026-03-03T18:57:13.637ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
101042026-03-03T18:57:13.637ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
101052026-03-03T18:57:13.637ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 58.386863ms iteration = 8 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
101062026-03-03T18:57:13.637ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 9 reason = Signaled
101072026-03-03T18:57:13.638ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
101082026-03-03T18:57:13.638ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
101092026-03-03T18:57:13.638ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
101102026-03-03T18:57:13.638ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101112026-03-03T18:57:13.638ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101122026-03-03T18:57:13.639ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101132026-03-03T18:57:13.639ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101142026-03-03T18:57:13.640ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:36085/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c4207cc-ee7f-418d-b3e0-a351697bf3cc", "content-length": "152", "date": "Tue, 03 Mar 2026 18:57:13 GMT"} })
101152026-03-03T18:57:13.640ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
101162026-03-03T18:57:13.640ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101172026-03-03T18:57:13.640ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101182026-03-03T18:57:13.641ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 85 12 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:24977 req_id = 10f85ac3-1a9d-4451-89e5-f5ebdf930fc3
101192026-03-03T18:57:13.641ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 34066,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:24977 req_id = 10f85ac3-1a9d-4451-89e5-f5ebdf930fc3
101202026-03-03T18:57:13.641ZDEBGtest_metrics (store): query key key = _dendrite._tcp
101212026-03-03T18:57:13.641ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
101222026-03-03T18:57:13.642ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:24977 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 10f85ac3-1a9d-4451-89e5-f5ebdf930fc3
101232026-03-03T18:57:13.642ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 34679, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1970, tv_nsec: 906624665 } })
101242026-03-03T18:57:13.642ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
101252026-03-03T18:57:13.642ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: de 87 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:34759 req_id = 6dc44930-469d-4380-993b-d528528c073d
101262026-03-03T18:57:13.642ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 56967,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:34759 req_id = 6dc44930-469d-4380-993b-d528528c073d
101272026-03-03T18:57:13.643ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
101282026-03-03T18:57:13.643ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:34759 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 6dc44930-469d-4380-993b-d528528c073d
101292026-03-03T18:57:13.643ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101302026-03-03T18:57:13.643ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101312026-03-03T18:57:13.643ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101322026-03-03T18:57:13.643ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101332026-03-03T18:57:13.663ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:34679/switch/identifiers
101342026-03-03T18:57:13.664ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:34679/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "597c074e-54e8-400a-8ee8-a01a19e0b461", "content-length": "206", "date": "Tue, 03 Mar 2026 18:57:13 GMT"} })
101352026-03-03T18:57:13.664ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
101362026-03-03T18:57:13.664ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
101372026-03-03T18:57:13.664ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
101382026-03-03T18:57:13.664ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
101392026-03-03T18:57:13.665ZINFOtest_metrics (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager sled = SimGimlet00
101402026-03-03T18:57:13.665ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:36085/eip-gateways
101412026-03-03T18:57:13.665ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101422026-03-03T18:57:13.670ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101432026-03-03T18:57:13.671ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101442026-03-03T18:57:13.671ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101452026-03-03T18:57:13.671ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101462026-03-03T18:57:13.671ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101472026-03-03T18:57:13.671ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101482026-03-03T18:57:13.672ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35826 req_id = 5a1e8341-91f9-456b-b761-1f5f1ef7997f sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
101492026-03-03T18:57:13.672ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35826 req_id = 5a1e8341-91f9-456b-b761-1f5f1ef7997f sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways version = 23.0.0
101502026-03-03T18:57:13.672ZINFOtest_metrics (dropshot): request completed latency_us = 224 local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35826 req_id = 5a1e8341-91f9-456b-b761-1f5f1ef7997f response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
101512026-03-03T18:57:13.672ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:36085/eip-gateways", status: 204, headers: {"x-request-id": "5a1e8341-91f9-456b-b761-1f5f1ef7997f", "date": "Tue, 03 Mar 2026 18:57:13 GMT"} })
101522026-03-03T18:57:13.672ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
101532026-03-03T18:57:13.672ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101542026-03-03T18:57:13.673ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101552026-03-03T18:57:13.673ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
101562026-03-03T18:57:13.673ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
101572026-03-03T18:57:13.673ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
101582026-03-03T18:57:13.673ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
101592026-03-03T18:57:13.674ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
101602026-03-03T18:57:13.674ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101612026-03-03T18:57:13.674ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101622026-03-03T18:57:13.674ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101632026-03-03T18:57:13.674ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101642026-03-03T18:57:13.675ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
101652026-03-03T18:57:13.675ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101662026-03-03T18:57:13.676ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101672026-03-03T18:57:13.676ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
101682026-03-03T18:57:13.676ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
101692026-03-03T18:57:13.676ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
101702026-03-03T18:57:13.676ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
101712026-03-03T18:57:13.677ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
101722026-03-03T18:57:13.677ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101732026-03-03T18:57:13.677ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101742026-03-03T18:57:13.677ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101752026-03-03T18:57:13.677ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101762026-03-03T18:57:13.679ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101772026-03-03T18:57:13.684ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: bdb0e66e-b155-4e1a-9820-055b72e5342d, lookup_type: ById(bdb0e66e-b155-4e1a-9820-055b72e5342d) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101782026-03-03T18:57:13.684ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101792026-03-03T18:57:13.684ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101802026-03-03T18:57:13.684ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101812026-03-03T18:57:13.685ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
101822026-03-03T18:57:13.685ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101832026-03-03T18:57:13.685ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101842026-03-03T18:57:13.687ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101852026-03-03T18:57:13.687ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101862026-03-03T18:57:13.687ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101872026-03-03T18:57:13.687ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101882026-03-03T18:57:13.687ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101892026-03-03T18:57:13.688ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
101902026-03-03T18:57:13.688ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101912026-03-03T18:57:13.688ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101922026-03-03T18:57:13.689ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
101932026-03-03T18:57:13.689ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101942026-03-03T18:57:13.689ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101952026-03-03T18:57:13.690ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101962026-03-03T18:57:13.691ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101972026-03-03T18:57:13.691ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101982026-03-03T18:57:13.691ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
101992026-03-03T18:57:13.691ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
102002026-03-03T18:57:13.693ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102012026-03-03T18:57:13.693ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102022026-03-03T18:57:13.693ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102032026-03-03T18:57:13.694ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102042026-03-03T18:57:13.694ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102052026-03-03T18:57:13.695ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102062026-03-03T18:57:13.696ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) }, key: 602a71f8-025d-4629-ad7c-2ab5eb222ba4, lookup_type: ById(602a71f8-025d-4629-ad7c-2ab5eb222ba4) }
102072026-03-03T18:57:13.696ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project
102082026-03-03T18:57:13.696ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102092026-03-03T18:57:13.696ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102102026-03-03T18:57:13.696ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102112026-03-03T18:57:13.697ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
102122026-03-03T18:57:13.697ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102132026-03-03T18:57:13.697ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102142026-03-03T18:57:13.698ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102152026-03-03T18:57:13.699ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
102162026-03-03T18:57:13.699ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102172026-03-03T18:57:13.699ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102182026-03-03T18:57:13.699ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102192026-03-03T18:57:13.705ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
102202026-03-03T18:57:13.705ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
102212026-03-03T18:57:13.705ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
102222026-03-03T18:57:13.705ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
102232026-03-03T18:57:13.706ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
102242026-03-03T18:57:13.707ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102252026-03-03T18:57:13.712ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) }, key: 602a71f8-025d-4629-ad7c-2ab5eb222ba4, lookup_type: ById(602a71f8-025d-4629-ad7c-2ab5eb222ba4) } result = Ok(())
102262026-03-03T18:57:13.712ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "VpcRouter" using built-in user background_task = vpc_route_manager
102272026-03-03T18:57:13.712ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) }, key: 602a71f8-025d-4629-ad7c-2ab5eb222ba4, lookup_type: ById(602a71f8-025d-4629-ad7c-2ab5eb222ba4) }
102282026-03-03T18:57:13.713ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project
102292026-03-03T18:57:13.713ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102302026-03-03T18:57:13.713ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102312026-03-03T18:57:13.713ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102322026-03-03T18:57:13.714ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
102332026-03-03T18:57:13.714ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102342026-03-03T18:57:13.714ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102352026-03-03T18:57:13.715ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102362026-03-03T18:57:13.715ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
102372026-03-03T18:57:13.715ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
102382026-03-03T18:57:13.715ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
102392026-03-03T18:57:13.716ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
102402026-03-03T18:57:13.717ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
102412026-03-03T18:57:13.717ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102422026-03-03T18:57:13.717ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102432026-03-03T18:57:13.717ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102442026-03-03T18:57:13.717ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
102452026-03-03T18:57:13.717ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
102462026-03-03T18:57:13.717ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
102472026-03-03T18:57:13.717ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
102482026-03-03T18:57:13.718ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
102492026-03-03T18:57:13.718ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102502026-03-03T18:57:13.724ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) }, key: 602a71f8-025d-4629-ad7c-2ab5eb222ba4, lookup_type: ById(602a71f8-025d-4629-ad7c-2ab5eb222ba4) } result = Ok(())
102512026-03-03T18:57:13.724ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102522026-03-03T18:57:13.724ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102532026-03-03T18:57:13.724ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102542026-03-03T18:57:13.725ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
102552026-03-03T18:57:13.725ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
102562026-03-03T18:57:13.726ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
102572026-03-03T18:57:13.726ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 88.903743ms iteration = 9 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
102582026-03-03T18:57:13.728ZINFOtest_metrics (dropshot_external): request completed latency_us = 1402493 local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = ac56ce2f-e159-4c37-a4c4-5c49facc9e62 response_code = 201 uri = /v1/instances?project=p-1
102592026-03-03T18:57:13.728ZINFOtest_metrics (external client test context): client received response status = 201
102602026-03-03T18:57:13.728ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
102612026-03-03T18:57:13.728ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
102622026-03-03T18:57:13.728ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
102632026-03-03T18:57:13.728ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
102642026-03-03T18:57:13.728ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
102652026-03-03T18:57:13.728ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
102662026-03-03T18:57:13.729ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
102672026-03-03T18:57:13.729ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
102682026-03-03T18:57:13.729ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493 version = 2026021900.0.0
102692026-03-03T18:57:13.729ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 547d0305-ebc7-4812-a3e4-a7066ff4b5fc uri = /913233fe-92a8-4635-9572-183f495429c4
102702026-03-03T18:57:13.729ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
102712026-03-03T18:57:13.729ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
102722026-03-03T18:57:13.729ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
102732026-03-03T18:57:13.729ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
102742026-03-03T18:57:13.730ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
102752026-03-03T18:57:13.736ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6810 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 547d0305-ebc7-4812-a3e4-a7066ff4b5fc response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
102762026-03-03T18:57:13.736ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102772026-03-03T18:57:13.736ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102782026-03-03T18:57:13.736ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102792026-03-03T18:57:13.737ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
102802026-03-03T18:57:13.746ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
102812026-03-03T18:57:13.746ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
102822026-03-03T18:57:13.746ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
102832026-03-03T18:57:13.746ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
102842026-03-03T18:57:13.746ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
102852026-03-03T18:57:13.746ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
102862026-03-03T18:57:13.746ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
102872026-03-03T18:57:13.747ZDEBGtest_metrics (results-sink): inserting 22 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
102882026-03-03T18:57:13.747ZDEBGtest_metrics (results-sink-cluster): inserting 22 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
102892026-03-03T18:57:13.747ZDEBGtest_metrics (clickhouse-client): unrolling 22 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
102902026-03-03T18:57:13.754ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
102912026-03-03T18:57:13.754ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
102922026-03-03T18:57:13.755ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
102932026-03-03T18:57:13.755ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
102942026-03-03T18:57:13.755ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102952026-03-03T18:57:13.755ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102962026-03-03T18:57:13.756ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102972026-03-03T18:57:13.757ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
102982026-03-03T18:57:13.759ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
102992026-03-03T18:57:13.759ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103002026-03-03T18:57:13.759ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103012026-03-03T18:57:13.759ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103022026-03-03T18:57:13.759ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
103032026-03-03T18:57:13.759ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103042026-03-03T18:57:13.759ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103052026-03-03T18:57:13.759ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
103062026-03-03T18:57:13.759ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103072026-03-03T18:57:13.759ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103082026-03-03T18:57:13.760ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103092026-03-03T18:57:13.760ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
103102026-03-03T18:57:13.760ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103112026-03-03T18:57:13.760ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103122026-03-03T18:57:13.761ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 32 table_name = fields_string
103132026-03-03T18:57:13.761ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
103142026-03-03T18:57:13.761ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
103152026-03-03T18:57:13.763ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
103162026-03-03T18:57:13.763ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103172026-03-03T18:57:13.763ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103182026-03-03T18:57:13.764ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103192026-03-03T18:57:13.764ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) }, key: 954cc302-beec-4b31-9846-5142d8600ee1, lookup_type: ById(954cc302-beec-4b31-9846-5142d8600ee1) }
103202026-03-03T18:57:13.764ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project
103212026-03-03T18:57:13.764ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
103222026-03-03T18:57:13.764ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103232026-03-03T18:57:13.765ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103242026-03-03T18:57:13.765ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
103252026-03-03T18:57:13.766ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
103262026-03-03T18:57:13.766ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103272026-03-03T18:57:13.766ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103282026-03-03T18:57:13.766ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103292026-03-03T18:57:13.766ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
103302026-03-03T18:57:13.766ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
103312026-03-03T18:57:13.766ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103322026-03-03T18:57:13.767ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103332026-03-03T18:57:13.767ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_u16
103342026-03-03T18:57:13.767ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 21 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
103352026-03-03T18:57:13.768ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
103362026-03-03T18:57:13.768ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103372026-03-03T18:57:13.768ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103382026-03-03T18:57:13.768ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103392026-03-03T18:57:13.769ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
103402026-03-03T18:57:13.769ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
103412026-03-03T18:57:13.769ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103422026-03-03T18:57:13.770ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103432026-03-03T18:57:13.771ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
103442026-03-03T18:57:13.773ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
103452026-03-03T18:57:13.773ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103462026-03-03T18:57:13.773ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103472026-03-03T18:57:13.773ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103482026-03-03T18:57:13.773ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103492026-03-03T18:57:13.773ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103502026-03-03T18:57:13.773ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103512026-03-03T18:57:13.774ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 21 table_name = fields_uuid
103522026-03-03T18:57:13.775ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
103532026-03-03T18:57:13.775ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103542026-03-03T18:57:13.780ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) }, key: 954cc302-beec-4b31-9846-5142d8600ee1, lookup_type: ById(954cc302-beec-4b31-9846-5142d8600ee1) } result = Ok(())
103552026-03-03T18:57:13.780ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = vpc_route_manager
103562026-03-03T18:57:13.780ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
103572026-03-03T18:57:13.780ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103582026-03-03T18:57:13.780ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103592026-03-03T18:57:13.781ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103602026-03-03T18:57:13.781ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103612026-03-03T18:57:13.781ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103622026-03-03T18:57:13.781ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103632026-03-03T18:57:13.782ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
103642026-03-03T18:57:13.783ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103652026-03-03T18:57:13.783ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103662026-03-03T18:57:13.783ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103672026-03-03T18:57:13.784ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103682026-03-03T18:57:13.784ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103692026-03-03T18:57:13.784ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103702026-03-03T18:57:13.784ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103712026-03-03T18:57:13.785ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = measurements_histogramu64
103722026-03-03T18:57:13.785ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 7 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
103732026-03-03T18:57:13.785ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
103742026-03-03T18:57:13.785ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103752026-03-03T18:57:13.786ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103762026-03-03T18:57:13.788ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103772026-03-03T18:57:13.788ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103782026-03-03T18:57:13.788ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103792026-03-03T18:57:13.788ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
103802026-03-03T18:57:13.788ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103812026-03-03T18:57:13.788ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103822026-03-03T18:57:13.788ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103832026-03-03T18:57:13.788ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103842026-03-03T18:57:13.788ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103852026-03-03T18:57:13.788ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103862026-03-03T18:57:13.788ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103872026-03-03T18:57:13.789ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 7 table_name = measurements_i64
103882026-03-03T18:57:13.789ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
103892026-03-03T18:57:13.789ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
103902026-03-03T18:57:13.789ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
103912026-03-03T18:57:13.790ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
103922026-03-03T18:57:13.790ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) }, key: 954cc302-beec-4b31-9846-5142d8600ee1, lookup_type: ByName("default") }
103932026-03-03T18:57:13.790ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project
103942026-03-03T18:57:13.790ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
103952026-03-03T18:57:13.790ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103962026-03-03T18:57:13.790ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103972026-03-03T18:57:13.791ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103982026-03-03T18:57:13.792ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
103992026-03-03T18:57:13.792ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104002026-03-03T18:57:13.792ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104012026-03-03T18:57:13.792ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
104022026-03-03T18:57:13.792ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
104032026-03-03T18:57:13.792ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104042026-03-03T18:57:13.792ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104052026-03-03T18:57:13.792ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104062026-03-03T18:57:13.793ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104072026-03-03T18:57:13.793ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104082026-03-03T18:57:13.793ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104092026-03-03T18:57:13.793ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
104102026-03-03T18:57:13.793ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
104112026-03-03T18:57:13.794ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
104122026-03-03T18:57:13.794ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
104132026-03-03T18:57:13.794ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104142026-03-03T18:57:13.794ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104152026-03-03T18:57:13.794ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104162026-03-03T18:57:13.799ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104172026-03-03T18:57:13.800ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104182026-03-03T18:57:13.800ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104192026-03-03T18:57:13.800ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104202026-03-03T18:57:13.800ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104212026-03-03T18:57:13.800ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104222026-03-03T18:57:13.800ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104232026-03-03T18:57:13.806ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) }, key: 954cc302-beec-4b31-9846-5142d8600ee1, lookup_type: ByName("default") } result = Ok(())
104242026-03-03T18:57:13.806ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = vpc_route_manager
104252026-03-03T18:57:13.806ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
104262026-03-03T18:57:13.806ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104272026-03-03T18:57:13.806ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104282026-03-03T18:57:13.807ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104292026-03-03T18:57:13.807ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104302026-03-03T18:57:13.807ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104312026-03-03T18:57:13.807ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104322026-03-03T18:57:13.808ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
104332026-03-03T18:57:13.809ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
104342026-03-03T18:57:13.809ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
104352026-03-03T18:57:13.809ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104362026-03-03T18:57:13.809ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104372026-03-03T18:57:13.809ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104382026-03-03T18:57:13.810ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104392026-03-03T18:57:13.812ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '47174ca8-7062-4b5d-a8de-3ad573d1f493') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
104402026-03-03T18:57:13.814ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
104412026-03-03T18:57:13.814ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104422026-03-03T18:57:13.814ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104432026-03-03T18:57:13.814ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
104442026-03-03T18:57:13.814ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104452026-03-03T18:57:13.815ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104462026-03-03T18:57:13.815ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (11045350386984208624) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:13.728684236' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
104472026-03-03T18:57:13.816ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) }, key: 55ae9f25-759e-470b-865c-709fb5391660, lookup_type: ByName("default") }
104482026-03-03T18:57:13.816ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project
104492026-03-03T18:57:13.816ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
104502026-03-03T18:57:13.816ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104512026-03-03T18:57:13.817ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104522026-03-03T18:57:13.818ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
104532026-03-03T18:57:13.818ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
104542026-03-03T18:57:13.818ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104552026-03-03T18:57:13.818ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104562026-03-03T18:57:13.819ZINFOtest_metrics (dropshot_external): request completed latency_us = 89967 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 0b11170f-ead9-417f-baab-a97dc71929f8 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.728684236Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104572026-03-03T18:57:13.819ZINFOtest_metrics (external client test context): client received response status = 200
104582026-03-03T18:57:13.819ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104592026-03-03T18:57:13.820ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
104602026-03-03T18:57:13.820ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
104612026-03-03T18:57:13.820ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
104622026-03-03T18:57:13.820ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
104632026-03-03T18:57:13.820ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
104642026-03-03T18:57:13.820ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
104652026-03-03T18:57:13.820ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
104662026-03-03T18:57:13.820ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
104672026-03-03T18:57:13.820ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104682026-03-03T18:57:13.820ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104692026-03-03T18:57:13.821ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104702026-03-03T18:57:13.823ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493 version = 2026021900.0.0
104712026-03-03T18:57:13.823ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 8c28b48e-beb5-44da-8620-801a80e1fcb7 uri = /913233fe-92a8-4635-9572-183f495429c4
104722026-03-03T18:57:13.823ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104732026-03-03T18:57:13.823ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
104742026-03-03T18:57:13.823ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104752026-03-03T18:57:13.823ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104762026-03-03T18:57:13.823ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104772026-03-03T18:57:13.827ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6501 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 8c28b48e-beb5-44da-8620-801a80e1fcb7 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
104782026-03-03T18:57:13.828ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
104792026-03-03T18:57:13.835ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
104802026-03-03T18:57:13.835ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
104812026-03-03T18:57:13.835ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
104822026-03-03T18:57:13.835ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
104832026-03-03T18:57:13.835ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
104842026-03-03T18:57:13.836ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
104852026-03-03T18:57:13.836ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
104862026-03-03T18:57:13.836ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
104872026-03-03T18:57:13.836ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
104882026-03-03T18:57:13.841ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
104892026-03-03T18:57:13.843ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104902026-03-03T18:57:13.847ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: d828fef3-ec51-44c7-b4a4-a37c1176c89a, lookup_type: ById(d828fef3-ec51-44c7-b4a4-a37c1176c89a) }, key: 55ae9f25-759e-470b-865c-709fb5391660, lookup_type: ByName("default") } result = Ok(())
104912026-03-03T18:57:13.847ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "InternetGateway" using built-in user background_task = vpc_route_manager
104922026-03-03T18:57:13.847ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:36085/vpc-routes
104932026-03-03T18:57:13.848ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104942026-03-03T18:57:13.848ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104952026-03-03T18:57:13.848ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104962026-03-03T18:57:13.849ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35826 req_id = 9f5c5707-9bf9-49c0-bec2-9bab8ba19af2 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
104972026-03-03T18:57:13.851ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35826 req_id = 9f5c5707-9bf9-49c0-bec2-9bab8ba19af2 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
104982026-03-03T18:57:13.852ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
104992026-03-03T18:57:13.852ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105002026-03-03T18:57:13.852ZINFOtest_metrics (dropshot): request completed latency_us = 544 local_addr = [::1]:36085 method = PUT remote_addr = [::1]:35826 req_id = 9f5c5707-9bf9-49c0-bec2-9bab8ba19af2 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
105012026-03-03T18:57:13.852ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:36085/vpc-routes", status: 204, headers: {"x-request-id": "9f5c5707-9bf9-49c0-bec2-9bab8ba19af2", "date": "Tue, 03 Mar 2026 18:57:13 GMT"} })
105022026-03-03T18:57:13.852ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 237.52115ms iteration = 3 status = {}
105032026-03-03T18:57:13.852ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
105042026-03-03T18:57:13.852ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
105052026-03-03T18:57:13.852ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105062026-03-03T18:57:13.852ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105072026-03-03T18:57:13.852ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105082026-03-03T18:57:13.852ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
105092026-03-03T18:57:13.852ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105102026-03-03T18:57:13.852ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105112026-03-03T18:57:13.852ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105122026-03-03T18:57:13.853ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 30 table_name = fields_string
105132026-03-03T18:57:13.853ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
105142026-03-03T18:57:13.853ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
105152026-03-03T18:57:13.856ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
105162026-03-03T18:57:13.856ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105172026-03-03T18:57:13.856ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105182026-03-03T18:57:13.856ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105192026-03-03T18:57:13.857ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
105202026-03-03T18:57:13.858ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
105212026-03-03T18:57:13.858ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105222026-03-03T18:57:13.858ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105232026-03-03T18:57:13.858ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105242026-03-03T18:57:13.859ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
105252026-03-03T18:57:13.859ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105262026-03-03T18:57:13.859ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105272026-03-03T18:57:13.859ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105282026-03-03T18:57:13.859ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_u16
105292026-03-03T18:57:13.859ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
105302026-03-03T18:57:13.860ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
105312026-03-03T18:57:13.862ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
105322026-03-03T18:57:13.862ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105332026-03-03T18:57:13.862ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105342026-03-03T18:57:13.862ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105352026-03-03T18:57:13.862ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105362026-03-03T18:57:13.862ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105372026-03-03T18:57:13.863ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105382026-03-03T18:57:13.863ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_uuid
105392026-03-03T18:57:13.863ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
105402026-03-03T18:57:13.864ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105412026-03-03T18:57:13.864ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105422026-03-03T18:57:13.864ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105432026-03-03T18:57:13.865ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105442026-03-03T18:57:13.865ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = measurements_histogramu64
105452026-03-03T18:57:13.865ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105462026-03-03T18:57:13.865ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105472026-03-03T18:57:13.865ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
105482026-03-03T18:57:13.866ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
105492026-03-03T18:57:13.867ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
105502026-03-03T18:57:13.867ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
105512026-03-03T18:57:13.867ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105522026-03-03T18:57:13.869ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105532026-03-03T18:57:13.871ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105542026-03-03T18:57:13.871ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105552026-03-03T18:57:13.871ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105562026-03-03T18:57:13.871ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105572026-03-03T18:57:13.871ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105582026-03-03T18:57:13.871ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105592026-03-03T18:57:13.871ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105602026-03-03T18:57:13.871ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105612026-03-03T18:57:13.871ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105622026-03-03T18:57:13.871ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105632026-03-03T18:57:13.872ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105642026-03-03T18:57:13.872ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
105652026-03-03T18:57:13.872ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105662026-03-03T18:57:13.873ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105672026-03-03T18:57:13.873ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105682026-03-03T18:57:13.873ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105692026-03-03T18:57:13.873ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105702026-03-03T18:57:13.875ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105712026-03-03T18:57:13.875ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105722026-03-03T18:57:13.875ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105732026-03-03T18:57:13.875ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105742026-03-03T18:57:13.876ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105752026-03-03T18:57:13.881ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105762026-03-03T18:57:13.881ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105772026-03-03T18:57:13.881ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105782026-03-03T18:57:13.881ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105792026-03-03T18:57:13.881ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105802026-03-03T18:57:13.881ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105812026-03-03T18:57:13.883ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105822026-03-03T18:57:13.883ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105832026-03-03T18:57:13.883ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105842026-03-03T18:57:13.883ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105852026-03-03T18:57:13.884ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105862026-03-03T18:57:13.886ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105872026-03-03T18:57:13.887ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '47174ca8-7062-4b5d-a8de-3ad573d1f493') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
105882026-03-03T18:57:13.890ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (8721817720517468360) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:13.819844762' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
105892026-03-03T18:57:13.893ZINFOtest_metrics (dropshot_external): request completed latency_us = 72261 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = eb8ea10d-85e1-4141-8253-f69b0beeefa3 response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.819844762Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105902026-03-03T18:57:13.894ZINFOtest_metrics (external client test context): client received response status = 200
105912026-03-03T18:57:13.894ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105922026-03-03T18:57:13.894ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
105932026-03-03T18:57:13.894ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
105942026-03-03T18:57:13.894ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
105952026-03-03T18:57:13.894ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
105962026-03-03T18:57:13.894ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
105972026-03-03T18:57:13.894ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
105982026-03-03T18:57:13.894ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
105992026-03-03T18:57:13.894ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493 version = 2026021900.0.0
106002026-03-03T18:57:13.894ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = f9361b64-e932-4878-ab15-c870eaee13ae uri = /913233fe-92a8-4635-9572-183f495429c4
106012026-03-03T18:57:13.894ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106022026-03-03T18:57:13.894ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106032026-03-03T18:57:13.894ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106042026-03-03T18:57:13.894ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106052026-03-03T18:57:13.895ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106062026-03-03T18:57:13.901ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7033 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = f9361b64-e932-4878-ab15-c870eaee13ae response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
106072026-03-03T18:57:13.902ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
106082026-03-03T18:57:13.909ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
106092026-03-03T18:57:13.909ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
106102026-03-03T18:57:13.909ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
106112026-03-03T18:57:13.909ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
106122026-03-03T18:57:13.909ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
106132026-03-03T18:57:13.909ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
106142026-03-03T18:57:13.909ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
106152026-03-03T18:57:13.909ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
106162026-03-03T18:57:13.910ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
106172026-03-03T18:57:13.915ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
106182026-03-03T18:57:13.916ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106192026-03-03T18:57:13.916ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106202026-03-03T18:57:13.917ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106212026-03-03T18:57:13.918ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 30 table_name = fields_string
106222026-03-03T18:57:13.918ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
106232026-03-03T18:57:13.918ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
106242026-03-03T18:57:13.918ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
106252026-03-03T18:57:13.918ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106262026-03-03T18:57:13.918ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106272026-03-03T18:57:13.919ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106282026-03-03T18:57:13.921ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
106292026-03-03T18:57:13.921ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106302026-03-03T18:57:13.921ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106312026-03-03T18:57:13.921ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106322026-03-03T18:57:13.921ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_u16
106332026-03-03T18:57:13.921ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
106342026-03-03T18:57:13.922ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
106352026-03-03T18:57:13.924ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
106362026-03-03T18:57:13.925ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106372026-03-03T18:57:13.925ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106382026-03-03T18:57:13.925ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106392026-03-03T18:57:13.925ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_uuid
106402026-03-03T18:57:13.925ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
106412026-03-03T18:57:13.926ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
106422026-03-03T18:57:13.926ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
106432026-03-03T18:57:13.926ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106442026-03-03T18:57:13.926ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106452026-03-03T18:57:13.926ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106462026-03-03T18:57:13.928ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
106472026-03-03T18:57:13.930ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106482026-03-03T18:57:13.930ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106492026-03-03T18:57:13.930ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106502026-03-03T18:57:13.930ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
106512026-03-03T18:57:13.931ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
106522026-03-03T18:57:13.931ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106532026-03-03T18:57:13.931ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106542026-03-03T18:57:13.931ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106552026-03-03T18:57:13.931ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106562026-03-03T18:57:13.931ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106572026-03-03T18:57:13.932ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106582026-03-03T18:57:13.934ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = measurements_histogramu64
106592026-03-03T18:57:13.934ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
106602026-03-03T18:57:13.934ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
106612026-03-03T18:57:13.934ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
106622026-03-03T18:57:13.934ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
106632026-03-03T18:57:13.934ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106642026-03-03T18:57:13.934ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106652026-03-03T18:57:13.934ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106662026-03-03T18:57:13.935ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106672026-03-03T18:57:13.935ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
106682026-03-03T18:57:13.935ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
106692026-03-03T18:57:13.936ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
106702026-03-03T18:57:13.936ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
106712026-03-03T18:57:13.936ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106722026-03-03T18:57:13.938ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106732026-03-03T18:57:13.940ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106742026-03-03T18:57:13.940ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106752026-03-03T18:57:13.940ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106762026-03-03T18:57:13.940ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106772026-03-03T18:57:13.940ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106782026-03-03T18:57:13.940ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106792026-03-03T18:57:13.941ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106802026-03-03T18:57:13.941ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106812026-03-03T18:57:13.941ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106822026-03-03T18:57:13.941ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106832026-03-03T18:57:13.942ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106842026-03-03T18:57:13.943ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106852026-03-03T18:57:13.944ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106862026-03-03T18:57:13.944ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106872026-03-03T18:57:13.944ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106882026-03-03T18:57:13.945ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106892026-03-03T18:57:13.945ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106902026-03-03T18:57:13.945ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106912026-03-03T18:57:13.945ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106922026-03-03T18:57:13.947ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106932026-03-03T18:57:13.951ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106942026-03-03T18:57:13.952ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106952026-03-03T18:57:13.952ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106962026-03-03T18:57:13.952ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106972026-03-03T18:57:13.952ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106982026-03-03T18:57:13.952ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
106992026-03-03T18:57:13.952ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
107002026-03-03T18:57:13.952ZDEBGtest_metrics (results-sink-cluster): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
107012026-03-03T18:57:13.953ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
107022026-03-03T18:57:13.953ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
107032026-03-03T18:57:13.953ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
107042026-03-03T18:57:13.954ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
107052026-03-03T18:57:13.955ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
107062026-03-03T18:57:13.957ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
107072026-03-03T18:57:13.958ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '47174ca8-7062-4b5d-a8de-3ad573d1f493') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
107082026-03-03T18:57:13.962ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (9383865214650852877) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:13.893899870' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
107092026-03-03T18:57:13.964ZINFOtest_metrics (dropshot_external): request completed latency_us = 69898 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = fdafa9fa-a772-4bfc-bc2c-7d3db6f97b10 response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.893899870Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
107102026-03-03T18:57:13.964ZINFOtest_metrics (external client test context): client received response status = 200
107112026-03-03T18:57:13.964ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107122026-03-03T18:57:13.964ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
107132026-03-03T18:57:13.964ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
107142026-03-03T18:57:13.964ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
107152026-03-03T18:57:13.965ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
107162026-03-03T18:57:13.965ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
107172026-03-03T18:57:13.965ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
107182026-03-03T18:57:13.965ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107192026-03-03T18:57:13.965ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1 version = 2026021900.0.0
107202026-03-03T18:57:13.965ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 5264535d-dac6-40ec-ab00-8abe82a5e18a uri = /913233fe-92a8-4635-9572-183f495429c4
107212026-03-03T18:57:13.965ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107222026-03-03T18:57:13.965ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107232026-03-03T18:57:13.965ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107242026-03-03T18:57:13.965ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107252026-03-03T18:57:13.966ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107262026-03-03T18:57:13.972ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6693 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 5264535d-dac6-40ec-ab00-8abe82a5e18a response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
107272026-03-03T18:57:13.972ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
107282026-03-03T18:57:13.979ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
107292026-03-03T18:57:13.979ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
107302026-03-03T18:57:13.979ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
107312026-03-03T18:57:13.979ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
107322026-03-03T18:57:13.980ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
107332026-03-03T18:57:13.980ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
107342026-03-03T18:57:13.980ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
107352026-03-03T18:57:13.980ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
107362026-03-03T18:57:13.980ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
107372026-03-03T18:57:13.985ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
107382026-03-03T18:57:13.987ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107392026-03-03T18:57:13.987ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107402026-03-03T18:57:13.987ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107412026-03-03T18:57:13.988ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 30 table_name = fields_string
107422026-03-03T18:57:13.988ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
107432026-03-03T18:57:13.989ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
107442026-03-03T18:57:13.989ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
107452026-03-03T18:57:13.989ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107462026-03-03T18:57:13.989ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107472026-03-03T18:57:13.989ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107482026-03-03T18:57:13.990ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
107492026-03-03T18:57:13.991ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107502026-03-03T18:57:13.991ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107512026-03-03T18:57:13.991ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107522026-03-03T18:57:13.991ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_u16
107532026-03-03T18:57:13.991ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
107542026-03-03T18:57:13.992ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
107552026-03-03T18:57:13.994ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
107562026-03-03T18:57:13.995ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107572026-03-03T18:57:13.995ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107582026-03-03T18:57:13.995ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107592026-03-03T18:57:13.996ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_uuid
107602026-03-03T18:57:13.996ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
107612026-03-03T18:57:13.996ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
107622026-03-03T18:57:13.996ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
107632026-03-03T18:57:13.996ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107642026-03-03T18:57:13.996ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107652026-03-03T18:57:13.996ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107662026-03-03T18:57:13.997ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
107672026-03-03T18:57:13.997ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107682026-03-03T18:57:13.997ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107692026-03-03T18:57:13.998ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107702026-03-03T18:57:13.999ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = measurements_histogramu64
107712026-03-03T18:57:13.999ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
107722026-03-03T18:57:13.999ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
107732026-03-03T18:57:13.999ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
107742026-03-03T18:57:13.999ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
107752026-03-03T18:57:13.999ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
107762026-03-03T18:57:14.002ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
107772026-03-03T18:57:14.002ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107782026-03-03T18:57:14.002ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107792026-03-03T18:57:14.002ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107802026-03-03T18:57:14.002ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107812026-03-03T18:57:14.002ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107822026-03-03T18:57:14.002ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107832026-03-03T18:57:14.003ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
107842026-03-03T18:57:14.003ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
107852026-03-03T18:57:14.004ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
107862026-03-03T18:57:14.004ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
107872026-03-03T18:57:14.004ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107882026-03-03T18:57:14.004ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107892026-03-03T18:57:14.004ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107902026-03-03T18:57:14.004ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107912026-03-03T18:57:14.006ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107922026-03-03T18:57:14.007ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107932026-03-03T18:57:14.007ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107942026-03-03T18:57:14.007ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107952026-03-03T18:57:14.007ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107962026-03-03T18:57:14.007ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107972026-03-03T18:57:14.008ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107982026-03-03T18:57:14.010ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
107992026-03-03T18:57:14.010ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
108002026-03-03T18:57:14.010ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
108012026-03-03T18:57:14.010ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
108022026-03-03T18:57:14.011ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
108032026-03-03T18:57:14.013ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
108042026-03-03T18:57:14.014ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
108052026-03-03T18:57:14.017ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:13.964771724' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
108062026-03-03T18:57:14.021ZINFOtest_metrics (dropshot_external): request completed latency_us = 55918 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = f78f138c-f3f4-45ea-90f5-11906ec2ab2f response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:13.964771724Z&order=descending&limit=1
108072026-03-03T18:57:14.021ZINFOtest_metrics (external client test context): client received response status = 200
108082026-03-03T18:57:14.021ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108092026-03-03T18:57:14.021ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
108102026-03-03T18:57:14.021ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
108112026-03-03T18:57:14.021ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
108122026-03-03T18:57:14.021ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
108132026-03-03T18:57:14.021ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
108142026-03-03T18:57:14.022ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
108152026-03-03T18:57:14.023ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108162026-03-03T18:57:14.023ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1 version = 2026021900.0.0
108172026-03-03T18:57:14.023ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = aacd3092-fc52-420b-b02e-3078c9991a85 uri = /913233fe-92a8-4635-9572-183f495429c4
108182026-03-03T18:57:14.023ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108192026-03-03T18:57:14.023ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108202026-03-03T18:57:14.023ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108212026-03-03T18:57:14.023ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108222026-03-03T18:57:14.023ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108232026-03-03T18:57:14.029ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6656 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = aacd3092-fc52-420b-b02e-3078c9991a85 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
108242026-03-03T18:57:14.029ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
108252026-03-03T18:57:14.036ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
108262026-03-03T18:57:14.036ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
108272026-03-03T18:57:14.036ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
108282026-03-03T18:57:14.036ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
108292026-03-03T18:57:14.036ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
108302026-03-03T18:57:14.036ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
108312026-03-03T18:57:14.036ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
108322026-03-03T18:57:14.037ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
108332026-03-03T18:57:14.037ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
108342026-03-03T18:57:14.042ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
108352026-03-03T18:57:14.043ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108362026-03-03T18:57:14.043ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108372026-03-03T18:57:14.043ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108382026-03-03T18:57:14.044ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 30 table_name = fields_string
108392026-03-03T18:57:14.044ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
108402026-03-03T18:57:14.045ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
108412026-03-03T18:57:14.045ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
108422026-03-03T18:57:14.045ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108432026-03-03T18:57:14.045ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108442026-03-03T18:57:14.045ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108452026-03-03T18:57:14.047ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_u16
108462026-03-03T18:57:14.047ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
108472026-03-03T18:57:14.048ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
108482026-03-03T18:57:14.048ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108492026-03-03T18:57:14.048ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108502026-03-03T18:57:14.048ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108512026-03-03T18:57:14.050ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
108522026-03-03T18:57:14.052ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
108532026-03-03T18:57:14.052ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108542026-03-03T18:57:14.052ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108552026-03-03T18:57:14.053ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108562026-03-03T18:57:14.053ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_uuid
108572026-03-03T18:57:14.053ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
108582026-03-03T18:57:14.053ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
108592026-03-03T18:57:14.054ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
108602026-03-03T18:57:14.056ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
108612026-03-03T18:57:14.057ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
108622026-03-03T18:57:14.057ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108632026-03-03T18:57:14.057ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108642026-03-03T18:57:14.057ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108652026-03-03T18:57:14.059ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
108662026-03-03T18:57:14.060ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108672026-03-03T18:57:14.060ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108682026-03-03T18:57:14.060ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108692026-03-03T18:57:14.061ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = measurements_histogramu64
108702026-03-03T18:57:14.061ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
108712026-03-03T18:57:14.061ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
108722026-03-03T18:57:14.061ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
108732026-03-03T18:57:14.062ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
108742026-03-03T18:57:14.064ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
108752026-03-03T18:57:14.064ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108762026-03-03T18:57:14.064ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108772026-03-03T18:57:14.064ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108782026-03-03T18:57:14.064ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108792026-03-03T18:57:14.064ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108802026-03-03T18:57:14.065ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108812026-03-03T18:57:14.065ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
108822026-03-03T18:57:14.065ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
108832026-03-03T18:57:14.068ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108842026-03-03T18:57:14.069ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108852026-03-03T18:57:14.069ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108862026-03-03T18:57:14.069ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108872026-03-03T18:57:14.069ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
108882026-03-03T18:57:14.069ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
108892026-03-03T18:57:14.070ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
108902026-03-03T18:57:14.070ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
108912026-03-03T18:57:14.070ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108922026-03-03T18:57:14.072ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108932026-03-03T18:57:14.072ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108942026-03-03T18:57:14.072ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108952026-03-03T18:57:14.072ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108962026-03-03T18:57:14.072ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108972026-03-03T18:57:14.072ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108982026-03-03T18:57:14.074ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
108992026-03-03T18:57:14.074ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
109002026-03-03T18:57:14.074ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
109012026-03-03T18:57:14.074ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
109022026-03-03T18:57:14.075ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
109032026-03-03T18:57:14.077ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
109042026-03-03T18:57:14.079ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
109052026-03-03T18:57:14.081ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:14.021718355' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
109062026-03-03T18:57:14.082ZINFOtest_metrics (dropshot_external): request completed latency_us = 60577 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = da4eba86-49b6-4627-9a4d-32cba7eb3e82 response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.021718355Z&order=descending&limit=1
109072026-03-03T18:57:14.083ZINFOtest_metrics (external client test context): client received response status = 200
109082026-03-03T18:57:14.083ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109092026-03-03T18:57:14.085ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
109102026-03-03T18:57:14.085ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
109112026-03-03T18:57:14.085ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
109122026-03-03T18:57:14.085ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
109132026-03-03T18:57:14.085ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
109142026-03-03T18:57:14.085ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
109152026-03-03T18:57:14.085ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109162026-03-03T18:57:14.085ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1 version = 2026021900.0.0
109172026-03-03T18:57:14.085ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = c352a616-2d71-47d1-a053-2104a93530ed uri = /913233fe-92a8-4635-9572-183f495429c4
109182026-03-03T18:57:14.085ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109192026-03-03T18:57:14.085ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109202026-03-03T18:57:14.085ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109212026-03-03T18:57:14.085ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109222026-03-03T18:57:14.085ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109232026-03-03T18:57:14.090ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6583 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = c352a616-2d71-47d1-a053-2104a93530ed response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
109242026-03-03T18:57:14.090ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
109252026-03-03T18:57:14.098ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
109262026-03-03T18:57:14.098ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
109272026-03-03T18:57:14.098ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
109282026-03-03T18:57:14.098ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
109292026-03-03T18:57:14.098ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
109302026-03-03T18:57:14.098ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
109312026-03-03T18:57:14.100ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
109322026-03-03T18:57:14.100ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
109332026-03-03T18:57:14.100ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
109342026-03-03T18:57:14.104ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
109352026-03-03T18:57:14.105ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109362026-03-03T18:57:14.105ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109372026-03-03T18:57:14.105ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109382026-03-03T18:57:14.106ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 30 table_name = fields_string
109392026-03-03T18:57:14.108ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
109402026-03-03T18:57:14.108ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
109412026-03-03T18:57:14.108ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
109422026-03-03T18:57:14.108ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109432026-03-03T18:57:14.108ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109442026-03-03T18:57:14.108ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109452026-03-03T18:57:14.108ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
109462026-03-03T18:57:14.108ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109472026-03-03T18:57:14.108ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109482026-03-03T18:57:14.108ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109492026-03-03T18:57:14.109ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_u16
109502026-03-03T18:57:14.111ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
109512026-03-03T18:57:14.111ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
109522026-03-03T18:57:14.112ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
109532026-03-03T18:57:14.112ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109542026-03-03T18:57:14.112ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109552026-03-03T18:57:14.112ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109562026-03-03T18:57:14.113ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_uuid
109572026-03-03T18:57:14.113ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
109582026-03-03T18:57:14.113ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
109592026-03-03T18:57:14.113ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
109602026-03-03T18:57:14.113ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109612026-03-03T18:57:14.113ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109622026-03-03T18:57:14.113ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109632026-03-03T18:57:14.114ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
109642026-03-03T18:57:14.115ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109652026-03-03T18:57:14.115ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109662026-03-03T18:57:14.115ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109672026-03-03T18:57:14.116ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
109682026-03-03T18:57:14.118ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
109692026-03-03T18:57:14.119ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109702026-03-03T18:57:14.119ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109712026-03-03T18:57:14.119ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109722026-03-03T18:57:14.119ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109732026-03-03T18:57:14.119ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109742026-03-03T18:57:14.119ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109752026-03-03T18:57:14.119ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = measurements_histogramu64
109762026-03-03T18:57:14.119ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
109772026-03-03T18:57:14.119ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
109782026-03-03T18:57:14.119ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
109792026-03-03T18:57:14.119ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
109802026-03-03T18:57:14.120ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109812026-03-03T18:57:14.120ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109822026-03-03T18:57:14.120ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109832026-03-03T18:57:14.121ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109842026-03-03T18:57:14.121ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
109852026-03-03T18:57:14.123ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
109862026-03-03T18:57:14.123ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109872026-03-03T18:57:14.124ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109882026-03-03T18:57:14.124ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109892026-03-03T18:57:14.124ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109902026-03-03T18:57:14.124ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109912026-03-03T18:57:14.124ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109922026-03-03T18:57:14.124ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109932026-03-03T18:57:14.126ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109942026-03-03T18:57:14.127ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109952026-03-03T18:57:14.127ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109962026-03-03T18:57:14.127ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
109972026-03-03T18:57:14.127ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
109982026-03-03T18:57:14.127ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
109992026-03-03T18:57:14.127ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
110002026-03-03T18:57:14.129ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
110012026-03-03T18:57:14.130ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
110022026-03-03T18:57:14.135ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:14.083336713' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
110032026-03-03T18:57:14.136ZINFOtest_metrics (dropshot_external): request completed latency_us = 52866 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 2ce60e0a-8cb8-400c-a253-a3a9e5c98057 response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.083336713Z&order=descending&limit=1
110042026-03-03T18:57:14.137ZINFOtest_metrics (external client test context): client received response status = 200
110052026-03-03T18:57:14.137ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
110062026-03-03T18:57:14.137ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
110072026-03-03T18:57:14.137ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
110082026-03-03T18:57:14.137ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
110092026-03-03T18:57:14.137ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
110102026-03-03T18:57:14.137ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
110112026-03-03T18:57:14.137ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
110122026-03-03T18:57:14.139ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
110132026-03-03T18:57:14.139ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1 version = 2026021900.0.0
110142026-03-03T18:57:14.139ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 6dacf453-b052-4388-9cb3-6fb6d60cfb14 uri = /913233fe-92a8-4635-9572-183f495429c4
110152026-03-03T18:57:14.139ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
110162026-03-03T18:57:14.139ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
110172026-03-03T18:57:14.139ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110182026-03-03T18:57:14.139ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110192026-03-03T18:57:14.139ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110202026-03-03T18:57:14.144ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6659 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 6dacf453-b052-4388-9cb3-6fb6d60cfb14 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
110212026-03-03T18:57:14.145ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
110222026-03-03T18:57:14.152ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
110232026-03-03T18:57:14.152ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
110242026-03-03T18:57:14.152ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
110252026-03-03T18:57:14.152ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
110262026-03-03T18:57:14.152ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
110272026-03-03T18:57:14.152ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
110282026-03-03T18:57:14.152ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
110292026-03-03T18:57:14.152ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
110302026-03-03T18:57:14.152ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
110312026-03-03T18:57:14.158ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
110322026-03-03T18:57:14.158ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
110332026-03-03T18:57:14.158ZDEBGtest_metrics (results-sink-cluster): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
110342026-03-03T18:57:14.159ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110352026-03-03T18:57:14.159ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110362026-03-03T18:57:14.159ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110372026-03-03T18:57:14.160ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 30 table_name = fields_string
110382026-03-03T18:57:14.160ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
110392026-03-03T18:57:14.160ZINFOtest_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
110402026-03-03T18:57:14.160ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
110412026-03-03T18:57:14.160ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 130b8940-ce14-4185-a745-e801a2d4bfea uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
110422026-03-03T18:57:14.160ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 130b8940-ce14-4185-a745-e801a2d4bfea uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
110432026-03-03T18:57:14.161ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 130b8940-ce14-4185-a745-e801a2d4bfea resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
110442026-03-03T18:57:14.161ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 130b8940-ce14-4185-a745-e801a2d4bfea roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
110452026-03-03T18:57:14.161ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 130b8940-ce14-4185-a745-e801a2d4bfea resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
110462026-03-03T18:57:14.162ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
110472026-03-03T18:57:14.162ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
110482026-03-03T18:57:14.162ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110492026-03-03T18:57:14.162ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110502026-03-03T18:57:14.162ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110512026-03-03T18:57:14.163ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_u16
110522026-03-03T18:57:14.163ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
110532026-03-03T18:57:14.163ZINFOtest_metrics (dropshot_internal): request completed latency_us = 2794 local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = 130b8940-ce14-4185-a745-e801a2d4bfea response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
110542026-03-03T18:57:14.163ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
110552026-03-03T18:57:14.163ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110562026-03-03T18:57:14.163ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110572026-03-03T18:57:14.164ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110582026-03-03T18:57:14.164ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "130b8940-ce14-4185-a745-e801a2d4bfea", "content-length": "405", "date": "Tue, 03 Mar 2026 18:57:14 GMT"} })
110592026-03-03T18:57:14.165ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
110602026-03-03T18:57:14.165ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_uuid
110612026-03-03T18:57:14.165ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
110622026-03-03T18:57:14.165ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = d5699039-864d-4c17-b4f8-0ceca679712d uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
110632026-03-03T18:57:14.165ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = d5699039-864d-4c17-b4f8-0ceca679712d uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D version = 1.0.0
110642026-03-03T18:57:14.165ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = d5699039-864d-4c17-b4f8-0ceca679712d resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
110652026-03-03T18:57:14.165ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = d5699039-864d-4c17-b4f8-0ceca679712d roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
110662026-03-03T18:57:14.166ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = d5699039-864d-4c17-b4f8-0ceca679712d resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
110672026-03-03T18:57:14.166ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
110682026-03-03T18:57:14.168ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
110692026-03-03T18:57:14.168ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110702026-03-03T18:57:14.168ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110712026-03-03T18:57:14.169ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110722026-03-03T18:57:14.170ZINFOtest_metrics (dropshot_internal): request completed latency_us = 4568 local_addr = 127.0.0.1:41339 method = GET remote_addr = 127.0.0.1:36732 req_id = d5699039-864d-4c17-b4f8-0ceca679712d response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
110732026-03-03T18:57:14.171ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:41339/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5699039-864d-4c17-b4f8-0ceca679712d", "content-length": "29", "date": "Tue, 03 Mar 2026 18:57:14 GMT"} })
110742026-03-03T18:57:14.171ZTRACtest_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4
110752026-03-03T18:57:14.171ZTRACtest_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
110762026-03-03T18:57:14.171ZINFOtest_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
110772026-03-03T18:57:14.171ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
110782026-03-03T18:57:14.172ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
110792026-03-03T18:57:14.172ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110802026-03-03T18:57:14.172ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110812026-03-03T18:57:14.172ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110822026-03-03T18:57:14.172ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
110832026-03-03T18:57:14.172ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110842026-03-03T18:57:14.172ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110852026-03-03T18:57:14.172ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110862026-03-03T18:57:14.172ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = measurements_histogramu64
110872026-03-03T18:57:14.172ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
110882026-03-03T18:57:14.172ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
110892026-03-03T18:57:14.172ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
110902026-03-03T18:57:14.173ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
110912026-03-03T18:57:14.174ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
110922026-03-03T18:57:14.176ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
110932026-03-03T18:57:14.176ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
110942026-03-03T18:57:14.176ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
110952026-03-03T18:57:14.176ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
110962026-03-03T18:57:14.176ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
110972026-03-03T18:57:14.176ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
110982026-03-03T18:57:14.176ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
110992026-03-03T18:57:14.180ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
111002026-03-03T18:57:14.183ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
111012026-03-03T18:57:14.183ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
111022026-03-03T18:57:14.183ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
111032026-03-03T18:57:14.183ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
111042026-03-03T18:57:14.183ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
111052026-03-03T18:57:14.184ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
111062026-03-03T18:57:14.185ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
111072026-03-03T18:57:14.185ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
111082026-03-03T18:57:14.185ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
111092026-03-03T18:57:14.188ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
111102026-03-03T18:57:14.190ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
111112026-03-03T18:57:14.191ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
111122026-03-03T18:57:14.192ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
111132026-03-03T18:57:14.193ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (12379067900625785140) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:14.137247910' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
111142026-03-03T18:57:14.196ZINFOtest_metrics (dropshot_external): request completed latency_us = 58368 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 07a407c5-93c3-469f-a259-ad45a83df20e response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.137247910Z&order=descending&limit=1
111152026-03-03T18:57:14.196ZINFOtest_metrics (external client test context): client received response status = 200
111162026-03-03T18:57:14.196ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111172026-03-03T18:57:14.196ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
111182026-03-03T18:57:14.196ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
111192026-03-03T18:57:14.196ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
111202026-03-03T18:57:14.197ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111212026-03-03T18:57:14.197ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1 version = 2026021900.0.0
111222026-03-03T18:57:14.197ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 64d1da3f-48df-4f43-9e11-8ffbfe56bdf0 uri = /913233fe-92a8-4635-9572-183f495429c4
111232026-03-03T18:57:14.197ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111242026-03-03T18:57:14.197ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111252026-03-03T18:57:14.197ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
111262026-03-03T18:57:14.197ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
111272026-03-03T18:57:14.198ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111282026-03-03T18:57:14.203ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6326 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 64d1da3f-48df-4f43-9e11-8ffbfe56bdf0 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
111292026-03-03T18:57:14.204ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
111302026-03-03T18:57:14.211ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
111312026-03-03T18:57:14.211ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
111322026-03-03T18:57:14.211ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
111332026-03-03T18:57:14.211ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
111342026-03-03T18:57:14.211ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
111352026-03-03T18:57:14.216ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
111362026-03-03T18:57:14.217ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
111372026-03-03T18:57:14.217ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
111382026-03-03T18:57:14.218ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111392026-03-03T18:57:14.218ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 30 table_name = fields_string
111402026-03-03T18:57:14.218ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
111412026-03-03T18:57:14.219ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
111422026-03-03T18:57:14.219ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
111432026-03-03T18:57:14.219ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
111442026-03-03T18:57:14.219ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
111452026-03-03T18:57:14.220ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111462026-03-03T18:57:14.220ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_u16
111472026-03-03T18:57:14.220ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
111482026-03-03T18:57:14.221ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
111492026-03-03T18:57:14.221ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
111502026-03-03T18:57:14.221ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
111512026-03-03T18:57:14.221ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111522026-03-03T18:57:14.222ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_uuid
111532026-03-03T18:57:14.222ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
111542026-03-03T18:57:14.223ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
111552026-03-03T18:57:14.225ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
111562026-03-03T18:57:14.225ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
111572026-03-03T18:57:14.225ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
111582026-03-03T18:57:14.225ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111592026-03-03T18:57:14.226ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = measurements_histogramu64
111602026-03-03T18:57:14.226ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
111612026-03-03T18:57:14.226ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
111622026-03-03T18:57:14.226ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
111632026-03-03T18:57:14.227ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
111642026-03-03T18:57:14.227ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
111652026-03-03T18:57:14.227ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111662026-03-03T18:57:14.228ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
111672026-03-03T18:57:14.228ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
111682026-03-03T18:57:14.228ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
111692026-03-03T18:57:14.228ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111702026-03-03T18:57:14.229ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
111712026-03-03T18:57:14.236ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
111722026-03-03T18:57:14.236ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111732026-03-03T18:57:14.236ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111742026-03-03T18:57:14.236ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111752026-03-03T18:57:14.236ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111762026-03-03T18:57:14.236ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111772026-03-03T18:57:14.236ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111782026-03-03T18:57:14.236ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111792026-03-03T18:57:14.237ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111802026-03-03T18:57:14.237ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111812026-03-03T18:57:14.237ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111822026-03-03T18:57:14.237ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111832026-03-03T18:57:14.237ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111842026-03-03T18:57:14.237ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111852026-03-03T18:57:14.239ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111862026-03-03T18:57:14.242ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111872026-03-03T18:57:14.244ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
111882026-03-03T18:57:14.246ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (7763646387282271213) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:14.196717935' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
111892026-03-03T18:57:14.249ZINFOtest_metrics (dropshot_external): request completed latency_us = 52481 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = ee40c8bb-78f4-4634-a841-9b243ff04da0 response_code = 200 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.196717935Z&order=descending&limit=1
111902026-03-03T18:57:14.250ZINFOtest_metrics (external client test context): client received response status = 200
111912026-03-03T18:57:14.250ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
111922026-03-03T18:57:14.250ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
111932026-03-03T18:57:14.250ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1 version = 2026021900.0.0
111942026-03-03T18:57:14.250ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
111952026-03-03T18:57:14.251ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
111962026-03-03T18:57:14.251ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
111972026-03-03T18:57:14.251ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
111982026-03-03T18:57:14.251ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111992026-03-03T18:57:14.252ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
112002026-03-03T18:57:14.252ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
112012026-03-03T18:57:14.253ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
112022026-03-03T18:57:14.254ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
112032026-03-03T18:57:14.254ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
112042026-03-03T18:57:14.254ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
112052026-03-03T18:57:14.254ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
112062026-03-03T18:57:14.254ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
112072026-03-03T18:57:14.255ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
112082026-03-03T18:57:14.255ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
112092026-03-03T18:57:14.256ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
112102026-03-03T18:57:14.256ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
112112026-03-03T18:57:14.257ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
112122026-03-03T18:57:14.259ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
112132026-03-03T18:57:14.260ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
112142026-03-03T18:57:14.260ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
112152026-03-03T18:57:14.260ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
112162026-03-03T18:57:14.260ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
112172026-03-03T18:57:14.260ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
112182026-03-03T18:57:14.260ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
112192026-03-03T18:57:14.260ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112202026-03-03T18:57:14.260ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112212026-03-03T18:57:14.260ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112222026-03-03T18:57:14.260ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112232026-03-03T18:57:14.260ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112242026-03-03T18:57:14.260ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112252026-03-03T18:57:14.261ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
112262026-03-03T18:57:14.261ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
112272026-03-03T18:57:14.261ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
112282026-03-03T18:57:14.261ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
112292026-03-03T18:57:14.262ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
112302026-03-03T18:57:14.262ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112312026-03-03T18:57:14.263ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112322026-03-03T18:57:14.263ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112332026-03-03T18:57:14.263ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112342026-03-03T18:57:14.263ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112352026-03-03T18:57:14.263ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
112362026-03-03T18:57:14.263ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
112372026-03-03T18:57:14.263ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
112382026-03-03T18:57:14.264ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
112392026-03-03T18:57:14.264ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
112402026-03-03T18:57:14.264ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
112412026-03-03T18:57:14.264ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
112422026-03-03T18:57:14.265ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112432026-03-03T18:57:14.266ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112442026-03-03T18:57:14.266ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112452026-03-03T18:57:14.266ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
112462026-03-03T18:57:14.266ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
112472026-03-03T18:57:14.268ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
112482026-03-03T18:57:14.269ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112492026-03-03T18:57:14.269ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112502026-03-03T18:57:14.269ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112512026-03-03T18:57:14.269ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112522026-03-03T18:57:14.269ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112532026-03-03T18:57:14.269ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112542026-03-03T18:57:14.269ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
112552026-03-03T18:57:14.269ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
112562026-03-03T18:57:14.271ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
112572026-03-03T18:57:14.271ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
112582026-03-03T18:57:14.271ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112592026-03-03T18:57:14.274ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112602026-03-03T18:57:14.276ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112612026-03-03T18:57:14.276ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112622026-03-03T18:57:14.276ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112632026-03-03T18:57:14.276ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112642026-03-03T18:57:14.276ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112652026-03-03T18:57:14.277ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112662026-03-03T18:57:14.280ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112672026-03-03T18:57:14.282ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
112682026-03-03T18:57:14.285ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10733361587332781639) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:14.250193340' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
112692026-03-03T18:57:14.287ZINFOtest_metrics (dropshot_external): request completed latency_us = 37513 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 24621d1c-e3b2-434a-b4d1-8e14e8b8c9d4 response_code = 200 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.250193340Z&order=descending&limit=1
112702026-03-03T18:57:14.288ZINFOtest_metrics (external client test context): client received response status = 200
112712026-03-03T18:57:14.288ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
112722026-03-03T18:57:14.288ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
112732026-03-03T18:57:14.288ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
112742026-03-03T18:57:14.288ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
112752026-03-03T18:57:14.288ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
112762026-03-03T18:57:14.289ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
112772026-03-03T18:57:14.289ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
112782026-03-03T18:57:14.289ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
112792026-03-03T18:57:14.290ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
112802026-03-03T18:57:14.291ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
112812026-03-03T18:57:14.291ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
112822026-03-03T18:57:14.292ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
112832026-03-03T18:57:14.293ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
112842026-03-03T18:57:14.293ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
112852026-03-03T18:57:14.293ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
112862026-03-03T18:57:14.293ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
112872026-03-03T18:57:14.294ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
112882026-03-03T18:57:14.294ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
112892026-03-03T18:57:14.294ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
112902026-03-03T18:57:14.294ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
112912026-03-03T18:57:14.295ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
112922026-03-03T18:57:14.297ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
112932026-03-03T18:57:14.297ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
112942026-03-03T18:57:14.297ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
112952026-03-03T18:57:14.297ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
112962026-03-03T18:57:14.298ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
112972026-03-03T18:57:14.298ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
112982026-03-03T18:57:14.298ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
112992026-03-03T18:57:14.298ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113002026-03-03T18:57:14.299ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113012026-03-03T18:57:14.300ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
113022026-03-03T18:57:14.301ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113032026-03-03T18:57:14.301ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113042026-03-03T18:57:14.301ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113052026-03-03T18:57:14.302ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
113062026-03-03T18:57:14.304ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
113072026-03-03T18:57:14.304ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113082026-03-03T18:57:14.304ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113092026-03-03T18:57:14.304ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113102026-03-03T18:57:14.304ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113112026-03-03T18:57:14.304ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113122026-03-03T18:57:14.304ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113132026-03-03T18:57:14.305ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113142026-03-03T18:57:14.308ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113152026-03-03T18:57:14.308ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113162026-03-03T18:57:14.308ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113172026-03-03T18:57:14.309ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113182026-03-03T18:57:14.310ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113192026-03-03T18:57:14.310ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113202026-03-03T18:57:14.310ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113212026-03-03T18:57:14.310ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113222026-03-03T18:57:14.310ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113232026-03-03T18:57:14.311ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113242026-03-03T18:57:14.312ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113252026-03-03T18:57:14.312ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113262026-03-03T18:57:14.312ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113272026-03-03T18:57:14.313ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113282026-03-03T18:57:14.315ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113292026-03-03T18:57:14.315ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113302026-03-03T18:57:14.315ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113312026-03-03T18:57:14.315ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113322026-03-03T18:57:14.315ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113332026-03-03T18:57:14.315ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113342026-03-03T18:57:14.316ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113352026-03-03T18:57:14.319ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113362026-03-03T18:57:14.321ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
113372026-03-03T18:57:14.324ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:14.288442872' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
113382026-03-03T18:57:14.327ZINFOtest_metrics (dropshot_external): request completed latency_us = 39289 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 480cbded-ab90-4cd9-9a6b-1a58509f1c62 response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.288442872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113392026-03-03T18:57:14.328ZINFOtest_metrics (external client test context): client received response status = 200
113402026-03-03T18:57:14.330ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113412026-03-03T18:57:14.330ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113422026-03-03T18:57:14.330ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
113432026-03-03T18:57:14.330ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113442026-03-03T18:57:14.330ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113452026-03-03T18:57:14.330ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113462026-03-03T18:57:14.330ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113472026-03-03T18:57:14.330ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113482026-03-03T18:57:14.331ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113492026-03-03T18:57:14.331ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113502026-03-03T18:57:14.332ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113512026-03-03T18:57:14.333ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
113522026-03-03T18:57:14.333ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
113532026-03-03T18:57:14.333ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113542026-03-03T18:57:14.333ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113552026-03-03T18:57:14.334ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113562026-03-03T18:57:14.335ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
113572026-03-03T18:57:14.335ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113582026-03-03T18:57:14.335ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113592026-03-03T18:57:14.335ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113602026-03-03T18:57:14.336ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
113612026-03-03T18:57:14.338ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
113622026-03-03T18:57:14.338ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113632026-03-03T18:57:14.338ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113642026-03-03T18:57:14.339ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113652026-03-03T18:57:14.340ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
113662026-03-03T18:57:14.340ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
113672026-03-03T18:57:14.340ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113682026-03-03T18:57:14.340ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113692026-03-03T18:57:14.340ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113702026-03-03T18:57:14.348ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
113712026-03-03T18:57:14.348ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113722026-03-03T18:57:14.348ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113732026-03-03T18:57:14.349ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113742026-03-03T18:57:14.350ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
113752026-03-03T18:57:14.352ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
113762026-03-03T18:57:14.353ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113772026-03-03T18:57:14.353ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113782026-03-03T18:57:14.353ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113792026-03-03T18:57:14.353ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113802026-03-03T18:57:14.353ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113812026-03-03T18:57:14.353ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113822026-03-03T18:57:14.354ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113832026-03-03T18:57:14.357ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113842026-03-03T18:57:14.358ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113852026-03-03T18:57:14.358ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113862026-03-03T18:57:14.358ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113872026-03-03T18:57:14.359ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113882026-03-03T18:57:14.359ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113892026-03-03T18:57:14.359ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113902026-03-03T18:57:14.359ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113912026-03-03T18:57:14.359ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
113922026-03-03T18:57:14.361ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
113932026-03-03T18:57:14.362ZDEBGtest_metrics (results-sink-cluster): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
113942026-03-03T18:57:14.362ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
113952026-03-03T18:57:14.362ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
113962026-03-03T18:57:14.362ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
113972026-03-03T18:57:14.362ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
113982026-03-03T18:57:14.362ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
113992026-03-03T18:57:14.362ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
114002026-03-03T18:57:14.362ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
114012026-03-03T18:57:14.362ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114022026-03-03T18:57:14.362ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114032026-03-03T18:57:14.362ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114042026-03-03T18:57:14.362ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114052026-03-03T18:57:14.362ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = ba4a2791-c4b4-4565-bb27-39cc32f6fc97 uri = /913233fe-92a8-4635-9572-183f495429c4
114062026-03-03T18:57:14.368ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5300 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = ba4a2791-c4b4-4565-bb27-39cc32f6fc97 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
114072026-03-03T18:57:14.368ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
114082026-03-03T18:57:14.375ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
114092026-03-03T18:57:14.375ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
114102026-03-03T18:57:14.375ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
114112026-03-03T18:57:14.375ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
114122026-03-03T18:57:14.375ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
114132026-03-03T18:57:14.381ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
114142026-03-03T18:57:14.381ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114152026-03-03T18:57:14.383ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114162026-03-03T18:57:14.384ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114172026-03-03T18:57:14.384ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114182026-03-03T18:57:14.384ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114192026-03-03T18:57:14.384ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114202026-03-03T18:57:14.384ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114212026-03-03T18:57:14.385ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 30 table_name = fields_string
114222026-03-03T18:57:14.385ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
114232026-03-03T18:57:14.385ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114242026-03-03T18:57:14.388ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114252026-03-03T18:57:14.390ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
114262026-03-03T18:57:14.390ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_u16
114272026-03-03T18:57:14.390ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
114282026-03-03T18:57:14.391ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_uuid
114292026-03-03T18:57:14.391ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
114302026-03-03T18:57:14.392ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:14.328453896' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
114312026-03-03T18:57:14.392ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = measurements_histogramu64
114322026-03-03T18:57:14.392ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
114332026-03-03T18:57:14.399ZINFOtest_metrics (dropshot_external): request completed latency_us = 70577 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 7a668369-107e-4655-af92-1ef63c148642 response_code = 200 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.328453896Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114342026-03-03T18:57:14.399ZINFOtest_metrics (external client test context): client received response status = 200
114352026-03-03T18:57:14.399ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114362026-03-03T18:57:14.400ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114372026-03-03T18:57:14.400ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
114382026-03-03T18:57:14.400ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114392026-03-03T18:57:14.400ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114402026-03-03T18:57:14.400ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
114412026-03-03T18:57:14.400ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
114422026-03-03T18:57:14.401ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
114432026-03-03T18:57:14.403ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
114442026-03-03T18:57:14.403ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
114452026-03-03T18:57:14.403ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
114462026-03-03T18:57:14.404ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
114472026-03-03T18:57:14.404ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
114482026-03-03T18:57:14.404ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
114492026-03-03T18:57:14.404ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
114502026-03-03T18:57:14.405ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
114512026-03-03T18:57:14.406ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
114522026-03-03T18:57:14.406ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
114532026-03-03T18:57:14.406ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
114542026-03-03T18:57:14.406ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
114552026-03-03T18:57:14.408ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
114562026-03-03T18:57:14.410ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
114572026-03-03T18:57:14.410ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
114582026-03-03T18:57:14.410ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
114592026-03-03T18:57:14.410ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
114602026-03-03T18:57:14.412ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
114612026-03-03T18:57:14.412ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
114622026-03-03T18:57:14.412ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
114632026-03-03T18:57:14.412ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
114642026-03-03T18:57:14.412ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
114652026-03-03T18:57:14.413ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
114662026-03-03T18:57:14.413ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
114672026-03-03T18:57:14.413ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
114682026-03-03T18:57:14.414ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
114692026-03-03T18:57:14.415ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
114702026-03-03T18:57:14.417ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
114712026-03-03T18:57:14.417ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114722026-03-03T18:57:14.417ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114732026-03-03T18:57:14.417ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114742026-03-03T18:57:14.417ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114752026-03-03T18:57:14.417ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114762026-03-03T18:57:14.417ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114772026-03-03T18:57:14.419ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114782026-03-03T18:57:14.422ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114792026-03-03T18:57:14.422ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114802026-03-03T18:57:14.422ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114812026-03-03T18:57:14.422ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114822026-03-03T18:57:14.424ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114832026-03-03T18:57:14.424ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114842026-03-03T18:57:14.424ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114852026-03-03T18:57:14.424ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114862026-03-03T18:57:14.424ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114872026-03-03T18:57:14.426ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114882026-03-03T18:57:14.426ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114892026-03-03T18:57:14.426ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114902026-03-03T18:57:14.426ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114912026-03-03T18:57:14.428ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114922026-03-03T18:57:14.429ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114932026-03-03T18:57:14.429ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114942026-03-03T18:57:14.429ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114952026-03-03T18:57:14.429ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114962026-03-03T18:57:14.429ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114972026-03-03T18:57:14.430ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114982026-03-03T18:57:14.431ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
114992026-03-03T18:57:14.434ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
115002026-03-03T18:57:14.436ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
115012026-03-03T18:57:14.439ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:14.399824610' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
115022026-03-03T18:57:14.441ZINFOtest_metrics (dropshot_external): request completed latency_us = 41280 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 100aa860-3962-4c10-9504-60f5ec37ead7 response_code = 200 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.399824610Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
115032026-03-03T18:57:14.441ZINFOtest_metrics (external client test context): client received response status = 200
115042026-03-03T18:57:14.441ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:37769/v1/disks?project=p-1
115052026-03-03T18:57:14.442ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e uri = /v1/disks?project=p-1
115062026-03-03T18:57:14.442ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e uri = /v1/disks?project=p-1 version = 2026021900.0.0
115072026-03-03T18:57:14.442ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e uri = /v1/disks?project=p-1
115082026-03-03T18:57:14.442ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/disks?project=p-1
115092026-03-03T18:57:14.442ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
115102026-03-03T18:57:14.442ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
115112026-03-03T18:57:14.443ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
115122026-03-03T18:57:14.444ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
115132026-03-03T18:57:14.444ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
115142026-03-03T18:57:14.444ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
115152026-03-03T18:57:14.445ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
115162026-03-03T18:57:14.445ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
115172026-03-03T18:57:14.446ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
115182026-03-03T18:57:14.446ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
115192026-03-03T18:57:14.446ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
115202026-03-03T18:57:14.447ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
115212026-03-03T18:57:14.447ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
115222026-03-03T18:57:14.447ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
115232026-03-03T18:57:14.448ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
115242026-03-03T18:57:14.449ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
115252026-03-03T18:57:14.451ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
115262026-03-03T18:57:14.451ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
115272026-03-03T18:57:14.451ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
115282026-03-03T18:57:14.451ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
115292026-03-03T18:57:14.452ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
115302026-03-03T18:57:14.452ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
115312026-03-03T18:57:14.452ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
115322026-03-03T18:57:14.452ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
115332026-03-03T18:57:14.453ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
115342026-03-03T18:57:14.454ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
115352026-03-03T18:57:14.454ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
115362026-03-03T18:57:14.454ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
115372026-03-03T18:57:14.454ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
115382026-03-03T18:57:14.455ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
115392026-03-03T18:57:14.457ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
115402026-03-03T18:57:14.457ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e uri = /v1/disks?project=p-1
115412026-03-03T18:57:14.457ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115422026-03-03T18:57:14.457ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115432026-03-03T18:57:14.457ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115442026-03-03T18:57:14.457ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115452026-03-03T18:57:14.457ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115462026-03-03T18:57:14.459ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115472026-03-03T18:57:14.460ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115482026-03-03T18:57:14.460ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115492026-03-03T18:57:14.460ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115502026-03-03T18:57:14.461ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115512026-03-03T18:57:14.462ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
115522026-03-03T18:57:14.462ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
115532026-03-03T18:57:14.462ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
115542026-03-03T18:57:14.462ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
115552026-03-03T18:57:14.462ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
115562026-03-03T18:57:14.462ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
115572026-03-03T18:57:14.462ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
115582026-03-03T18:57:14.462ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
115592026-03-03T18:57:14.462ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
115602026-03-03T18:57:14.463ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115612026-03-03T18:57:14.463ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115622026-03-03T18:57:14.463ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115632026-03-03T18:57:14.465ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
115642026-03-03T18:57:14.465ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
115652026-03-03T18:57:14.465ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
115662026-03-03T18:57:14.465ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42789
115672026-03-03T18:57:14.465ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115682026-03-03T18:57:14.465ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115692026-03-03T18:57:14.465ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115702026-03-03T18:57:14.466ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115712026-03-03T18:57:14.466ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115722026-03-03T18:57:14.466ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115732026-03-03T18:57:14.466ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115742026-03-03T18:57:14.467ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115752026-03-03T18:57:14.468ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115762026-03-03T18:57:14.468ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115772026-03-03T18:57:14.468ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115782026-03-03T18:57:14.468ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115792026-03-03T18:57:14.470ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115802026-03-03T18:57:14.470ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115812026-03-03T18:57:14.470ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115822026-03-03T18:57:14.470ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115832026-03-03T18:57:14.471ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115842026-03-03T18:57:14.475ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ByName("p-1") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
115852026-03-03T18:57:14.476ZINFOtest_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
115862026-03-03T18:57:14.476ZINFOtest_metrics (SagaExecutor): preparing saga saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create
115872026-03-03T18:57:14.476ZINFOtest_metrics (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.create_crucible_disk_record","label":"CreateCrucibleDiskRecord","name":"crucible_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"created_disk"}},{"Start":{"params":{"create_params":{"description":"sells rainsticks","disk_backend":{"disk_source":{"block_size":512,"type":"blank"},"type":"distributed"},"name":"d-1","size":1073741824},"project_id":"47174ca8-7062-4b5d-a8de-3ad573d1f493","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
115882026-03-03T18:57:14.476ZINFOtest_metrics (SecStore): creating saga saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create
115892026-03-03T18:57:14.477ZINFOtest_metrics (SagaExecutor): starting saga saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create
115902026-03-03T18:57:14.477ZINFOtest_metrics (SEC): saga start saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
115912026-03-03T18:57:14.478ZDEBGtest_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
115922026-03-03T18:57:14.478ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
115932026-03-03T18:57:14.479ZDEBGtest_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
115942026-03-03T18:57:14.479ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
115952026-03-03T18:57:14.480ZDEBGtest_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
115962026-03-03T18:57:14.480ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
115972026-03-03T18:57:14.481ZDEBGtest_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
115982026-03-03T18:57:14.481ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("7db6946a-2497-4886-9b71-0d7b1a2bd12b")) node_id = 0 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
115992026-03-03T18:57:14.482ZDEBGtest_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
116002026-03-03T18:57:14.482ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
116012026-03-03T18:57:14.483ZDEBGtest_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
116022026-03-03T18:57:14.483ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("7758e618-62be-44b3-a902-8971502dfffd")) node_id = 1 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
116032026-03-03T18:57:14.485ZDEBGtest_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
116042026-03-03T18:57:14.485ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
116052026-03-03T18:57:14.486ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = SpaceAccount silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116062026-03-03T18:57:14.486ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = SpaceAccount silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116072026-03-03T18:57:14.486ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = SpaceAccount silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116082026-03-03T18:57:14.491ZDEBGtest_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
116092026-03-03T18:57:14.491ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
116102026-03-03T18:57:14.493ZDEBGtest_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
116112026-03-03T18:57:14.493ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
116122026-03-03T18:57:14.494ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116132026-03-03T18:57:14.494ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116142026-03-03T18:57:14.495ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116152026-03-03T18:57:14.496ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116162026-03-03T18:57:14.496ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116172026-03-03T18:57:14.496ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116182026-03-03T18:57:14.497ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116192026-03-03T18:57:14.497ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116202026-03-03T18:57:14.497ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116212026-03-03T18:57:14.497ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116222026-03-03T18:57:14.498ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116232026-03-03T18:57:14.499ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116242026-03-03T18:57:14.499ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116252026-03-03T18:57:14.499ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116262026-03-03T18:57:14.500ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116272026-03-03T18:57:14.501ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116282026-03-03T18:57:14.501ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116292026-03-03T18:57:14.501ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116302026-03-03T18:57:14.502ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116312026-03-03T18:57:14.503ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116322026-03-03T18:57:14.507ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116332026-03-03T18:57:14.507ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116342026-03-03T18:57:14.507ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116352026-03-03T18:57:14.508ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116362026-03-03T18:57:14.508ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116372026-03-03T18:57:14.508ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116382026-03-03T18:57:14.510ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116392026-03-03T18:57:14.510ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116402026-03-03T18:57:14.510ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116412026-03-03T18:57:14.510ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116422026-03-03T18:57:14.511ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116432026-03-03T18:57:14.511ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116442026-03-03T18:57:14.511ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116452026-03-03T18:57:14.512ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116462026-03-03T18:57:14.513ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116472026-03-03T18:57:14.517ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116482026-03-03T18:57:14.517ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116492026-03-03T18:57:14.517ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116502026-03-03T18:57:14.518ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116512026-03-03T18:57:14.555ZDEBGtest_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
116522026-03-03T18:57:14.555ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "name": String("d-1"), "time_created": String("2026-03-03T18:57:14.494366Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:14.494366Z")}, "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T18:57:14.494364421Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}}) node_id = 3 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
116532026-03-03T18:57:14.557ZDEBGtest_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
116542026-03-03T18:57:14.557ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
116552026-03-03T18:57:14.558ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = RegionsAlloc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116562026-03-03T18:57:14.558ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = RegionsAlloc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116572026-03-03T18:57:14.559ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = RegionsAlloc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
116582026-03-03T18:57:14.564ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
116592026-03-03T18:57:14.564ZDEBGtest_metrics (results-sink-cluster): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
116602026-03-03T18:57:14.564ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
116612026-03-03T18:57:14.564ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
116622026-03-03T18:57:14.564ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
116632026-03-03T18:57:14.566ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 50493e9d-7f72-4f2a-aebe-7870e1e61fb3 uri = /913233fe-92a8-4635-9572-183f495429c4
116642026-03-03T18:57:14.570ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5389 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = 50493e9d-7f72-4f2a-aebe-7870e1e61fb3 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
116652026-03-03T18:57:14.570ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
116662026-03-03T18:57:14.578ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
116672026-03-03T18:57:14.578ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
116682026-03-03T18:57:14.578ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
116692026-03-03T18:57:14.578ZDEBGtest_metrics (results-sink): inserting 19 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
116702026-03-03T18:57:14.578ZDEBGtest_metrics (clickhouse-client): unrolling 19 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
116712026-03-03T18:57:14.585ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
116722026-03-03T18:57:14.586ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 32 table_name = fields_string
116732026-03-03T18:57:14.586ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
116742026-03-03T18:57:14.588ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = fields_u16
116752026-03-03T18:57:14.588ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 18 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
116762026-03-03T18:57:14.596ZINFOtest_metrics (datastore): Allocated regions for volume datasets_and_regions = [(CrucibleDataset { identity: CrucibleDatasetIdentity { id: e8989f88-588d-46eb-a9e1-551a762b720c (dataset), time_created: 2026-03-03T18:57:07.559137Z, time_modified: 2026-03-03T18:57:07.559137Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 9ae7bc40-1cd5-400d-9ab1-bf7c1213617c (zpool), ip: ::1, port: SqlU16(43333), size_used: 1342177280, no_provision: false }, Region { identity: RegionIdentity { id: 0aedbaff-67ef-48a9-ad7b-2ed040b6bc12, time_created: 2026-03-03T18:57:14.583557Z, time_modified: 2026-03-03T18:57:14.583557Z }, dataset_id: e8989f88-588d-46eb-a9e1-551a762b720c (dataset), volume_id: 7758e618-62be-44b3-a902-8971502dfffd (volume), block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false, reservation_percent: TwentyFive }), (CrucibleDataset { identity: CrucibleDatasetIdentity { id: e9d1f98f-6ec0-4943-9557-bf2fa89209f0 (dataset), time_created: 2026-03-03T18:57:06.781490Z, time_modified: 2026-03-03T18:57:06.781490Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 89c5eff8-6d6c-4e5d-af23-e1e997d2ec42 (zpool), ip: ::1, port: SqlU16(45597), size_used: 1342177280, no_provision: false }, Region { identity: RegionIdentity { id: 52432abd-5543-4e66-84b4-0860e0d5d0f5, time_created: 2026-03-03T18:57:14.583557Z, time_modified: 2026-03-03T18:57:14.583557Z }, dataset_id: e9d1f98f-6ec0-4943-9557-bf2fa89209f0 (dataset), volume_id: 7758e618-62be-44b3-a902-8971502dfffd (volume), block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false, reservation_percent: TwentyFive }), (CrucibleDataset { identity: CrucibleDatasetIdentity { id: f1c18a48-e3ab-4505-8dc5-08936c973d7a (dataset), time_created: 2026-03-03T18:57:07.757545Z, time_modified: 2026-03-03T18:57:07.757545Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 4663ee77-faf7-484d-b93c-0f9d30febdf8 (zpool), ip: ::1, port: SqlU16(36599), size_used: 1342177280, no_provision: false }, Region { identity: RegionIdentity { id: 834fc6a7-dc21-4077-8af4-ba1a9cc2c506, time_created: 2026-03-03T18:57:14.583557Z, time_modified: 2026-03-03T18:57:14.583557Z }, dataset_id: f1c18a48-e3ab-4505-8dc5-08936c973d7a (dataset), volume_id: 7758e618-62be-44b3-a902-8971502dfffd (volume), block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false, reservation_percent: TwentyFive })] maybe_snapshot_id = None volume_id = 7758e618-62be-44b3-a902-8971502dfffd
116772026-03-03T18:57:14.596ZDEBGtest_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
116782026-03-03T18:57:14.596ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"identity": Object {"id": String("e8989f88-588d-46eb-a9e1-551a762b720c"), "time_created": String("2026-03-03T18:57:07.559137Z"), "time_modified": String("2026-03-03T18:57:07.559137Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("9ae7bc40-1cd5-400d-9ab1-bf7c1213617c"), "port": Number(43333), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("e8989f88-588d-46eb-a9e1-551a762b720c"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("0aedbaff-67ef-48a9-ad7b-2ed040b6bc12"), "time_created": String("2026-03-03T18:57:14.583557Z"), "time_modified": String("2026-03-03T18:57:14.583557Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}], Array [Object {"identity": Object {"id": String("e9d1f98f-6ec0-4943-9557-bf2fa89209f0"), "time_created": String("2026-03-03T18:57:06.781490Z"), "time_modified": String("2026-03-03T18:57:06.781490Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("89c5eff8-6d6c-4e5d-af23-e1e997d2ec42"), "port": Number(45597), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("e9d1f98f-6ec0-4943-9557-bf2fa89209f0"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("52432abd-5543-4e66-84b4-0860e0d5d0f5"), "time_created": String("2026-03-03T18:57:14.583557Z"), "time_modified": String("2026-03-03T18:57:14.583557Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}], Array [Object {"identity": Object {"id": String("f1c18a48-e3ab-4505-8dc5-08936c973d7a"), "time_created": String("2026-03-03T18:57:07.757545Z"), "time_modified": String("2026-03-03T18:57:07.757545Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("4663ee77-faf7-484d-b93c-0f9d30febdf8"), "port": Number(36599), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f1c18a48-e3ab-4505-8dc5-08936c973d7a"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("834fc6a7-dc21-4077-8af4-ba1a9cc2c506"), "time_created": String("2026-03-03T18:57:14.583557Z"), "time_modified": String("2026-03-03T18:57:14.583557Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}]]) node_id = 4 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
116792026-03-03T18:57:14.598ZDEBGtest_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
116802026-03-03T18:57:14.598ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
116812026-03-03T18:57:14.599ZDEBGtest_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
116822026-03-03T18:57:14.599ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
116832026-03-03T18:57:14.601ZDEBGtest_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
116842026-03-03T18:57:14.601ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
116852026-03-03T18:57:14.601ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 18 table_name = fields_uuid
116862026-03-03T18:57:14.601ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
116872026-03-03T18:57:14.604ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 15 table_name = measurements_histogramu64
116882026-03-03T18:57:14.604ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 4 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
116892026-03-03T18:57:14.606ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 4 table_name = measurements_i64
116902026-03-03T18:57:14.606ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
116912026-03-03T18:57:14.606ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): accepted connection kind = storage local_addr = [::1]:45597 remote_addr = [::1]:47010 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
116922026-03-03T18:57:14.607ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): accepted connection kind = storage local_addr = [::1]:36599 remote_addr = [::1]:41920 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
116932026-03-03T18:57:14.629ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): accepted connection kind = storage local_addr = [::1]:43333 remote_addr = [::1]:58464 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
116942026-03-03T18:57:14.629ZTRACtest_metrics (Simulated CrucibleAgent Dropshot Server): incoming request kind = storage local_addr = [::1]:45597 method = POST remote_addr = [::1]:47010 req_id = b6ce3bf1-447c-43b5-827d-e71a58c77ada server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/0/regions
116952026-03-03T18:57:14.629ZTRACtest_metrics (Simulated CrucibleAgent Dropshot Server): incoming request kind = storage local_addr = [::1]:36599 method = POST remote_addr = [::1]:41920 req_id = 46824953-f43e-484b-bbf5-7fff8fd65c8e server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/0/regions
116962026-03-03T18:57:14.630ZTRACtest_metrics (Simulated CrucibleAgent Dropshot Server): incoming request kind = storage local_addr = [::1]:43333 method = POST remote_addr = [::1]:58464 req_id = d50ab10d-f2da-47da-bc1f-e21b0f9cc0a8 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/0/regions
116972026-03-03T18:57:14.630ZINFOtest_metrics (SledAgent): created region 52432abd-5543-4e66-84b4-0860e0d5d0f5 end_port = 1050 kind = storage server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_port = 1000
116982026-03-03T18:57:14.630ZINFOtest_metrics (SledAgent): created region 834fc6a7-dc21-4077-8af4-ba1a9cc2c506 end_port = 1150 kind = storage server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_port = 1100
116992026-03-03T18:57:14.630ZINFOtest_metrics (SledAgent): created region 0aedbaff-67ef-48a9-ad7b-2ed040b6bc12 end_port = 1100 kind = storage server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_port = 1050
117002026-03-03T18:57:14.630ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): request completed kind = storage latency_us = 367 local_addr = [::1]:45597 method = POST remote_addr = [::1]:47010 req_id = b6ce3bf1-447c-43b5-827d-e71a58c77ada response_code = 200 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/0/regions
117012026-03-03T18:57:14.630ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): request completed kind = storage latency_us = 334 local_addr = [::1]:36599 method = POST remote_addr = [::1]:41920 req_id = 46824953-f43e-484b-bbf5-7fff8fd65c8e response_code = 200 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/0/regions
117022026-03-03T18:57:14.630ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): request completed kind = storage latency_us = 316 local_addr = [::1]:43333 method = POST remote_addr = [::1]:58464 req_id = d50ab10d-f2da-47da-bc1f-e21b0f9cc0a8 response_code = 200 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/0/regions
117032026-03-03T18:57:14.638ZDEBGtest_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
117042026-03-03T18:57:14.638ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"block_size": Number(512), "id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "read_only_parent": Null, "sub_volumes": Array [Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "extent_count": Number(16), "gen": Number(1), "opts": Object {"cert_pem": Null, "control": Null, "flush_timeout": Null, "id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "key": String("VWI5dFE9qLAhtWGDHLhvJGhLaOK3p9HRE4hj26wqPso="), "key_pem": Null, "lossy": Bool(false), "read_only": Bool(false), "root_cert_pem": Null, "target": Array [String("[::1]:1100"), String("[::1]:1050"), String("[::1]:1000")]}, "type": String("region")}], "type": String("volume")}) node_id = 6 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
117052026-03-03T18:57:14.640ZDEBGtest_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
117062026-03-03T18:57:14.640ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
117072026-03-03T18:57:14.647ZDEBGtest_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
117082026-03-03T18:57:14.648ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
117092026-03-03T18:57:14.649ZDEBGtest_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
117102026-03-03T18:57:14.649ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
117112026-03-03T18:57:14.650ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117122026-03-03T18:57:14.650ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117132026-03-03T18:57:14.651ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117142026-03-03T18:57:14.652ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117152026-03-03T18:57:14.652ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117162026-03-03T18:57:14.653ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117172026-03-03T18:57:14.653ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117182026-03-03T18:57:14.653ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117192026-03-03T18:57:14.654ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117202026-03-03T18:57:14.655ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: 7db6946a-2497-4886-9b71-0d7b1a2bd12b, lookup_type: ById(7db6946a-2497-4886-9b71-0d7b1a2bd12b) } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117212026-03-03T18:57:14.655ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117222026-03-03T18:57:14.655ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117232026-03-03T18:57:14.655ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117242026-03-03T18:57:14.655ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117252026-03-03T18:57:14.656ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117262026-03-03T18:57:14.656ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117272026-03-03T18:57:14.657ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117282026-03-03T18:57:14.657ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117292026-03-03T18:57:14.658ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117302026-03-03T18:57:14.658ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117312026-03-03T18:57:14.658ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117322026-03-03T18:57:14.659ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117332026-03-03T18:57:14.660ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117342026-03-03T18:57:14.666ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: 7db6946a-2497-4886-9b71-0d7b1a2bd12b, lookup_type: ById(7db6946a-2497-4886-9b71-0d7b1a2bd12b) } result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117352026-03-03T18:57:14.666ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: 7db6946a-2497-4886-9b71-0d7b1a2bd12b, lookup_type: ById(7db6946a-2497-4886-9b71-0d7b1a2bd12b) } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117362026-03-03T18:57:14.666ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117372026-03-03T18:57:14.666ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117382026-03-03T18:57:14.666ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117392026-03-03T18:57:14.666ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117402026-03-03T18:57:14.666ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
117412026-03-03T18:57:14.666ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
117422026-03-03T18:57:14.666ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
117432026-03-03T18:57:14.666ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
117442026-03-03T18:57:14.666ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
117452026-03-03T18:57:14.667ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117462026-03-03T18:57:14.667ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117472026-03-03T18:57:14.668ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117482026-03-03T18:57:14.668ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117492026-03-03T18:57:14.668ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 2 table_name = fields_string
117502026-03-03T18:57:14.668ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
117512026-03-03T18:57:14.669ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 1 table_name = measurements_i64
117522026-03-03T18:57:14.669ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
117532026-03-03T18:57:14.669ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117542026-03-03T18:57:14.669ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117552026-03-03T18:57:14.669ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117562026-03-03T18:57:14.670ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117572026-03-03T18:57:14.671ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117582026-03-03T18:57:14.676ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) }, key: 7db6946a-2497-4886-9b71-0d7b1a2bd12b, lookup_type: ById(7db6946a-2497-4886-9b71-0d7b1a2bd12b) } result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117592026-03-03T18:57:14.676ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117602026-03-03T18:57:14.676ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117612026-03-03T18:57:14.676ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
117622026-03-03T18:57:14.679ZDEBGtest_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
117632026-03-03T18:57:14.679ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"Crucible": Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "name": String("d-1"), "time_created": String("2026-03-03T18:57:14.494366Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:14.494366Z")}, "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T18:57:14.494364421Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}}}) node_id = 8 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
117642026-03-03T18:57:14.681ZDEBGtest_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
117652026-03-03T18:57:14.681ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
117662026-03-03T18:57:14.682ZDEBGtest_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
117672026-03-03T18:57:14.682ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
117682026-03-03T18:57:14.683ZINFOtest_metrics (SEC): update for saga cached state new_state = Done saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc sec_id = 913233fe-92a8-4635-9572-183f495429c4
117692026-03-03T18:57:14.683ZINFOtest_metrics (SecStore): updating state new_state = done saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
117702026-03-03T18:57:14.685ZINFOtest_metrics (SEC): saga finished result = success saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
117712026-03-03T18:57:14.685ZINFOtest_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc
117722026-03-03T18:57:14.685ZINFOtest_metrics (SagaExecutor): saga finished saga_id = 7d111cca-afe8-4291-993a-0dcfc5f18adc saga_name = disk-create saga_result = SagaResult { saga_id: 7d111cca-afe8-4291-993a-0dcfc5f18adc, saga_log: SagaLog { saga_id: 7d111cca-afe8-4291-993a-0dcfc5f18adc, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("7db6946a-2497-4886-9b71-0d7b1a2bd12b")), 1: Succeeded(String("7758e618-62be-44b3-a902-8971502dfffd")), 2: Succeeded(Null), 3: Succeeded(Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "name": String("d-1"), "time_created": String("2026-03-03T18:57:14.494366Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:14.494366Z")}, "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T18:57:14.494364421Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}}), 4: Succeeded(Array [Array [Object {"identity": Object {"id": String("e8989f88-588d-46eb-a9e1-551a762b720c"), "time_created": String("2026-03-03T18:57:07.559137Z"), "time_modified": String("2026-03-03T18:57:07.559137Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("9ae7bc40-1cd5-400d-9ab1-bf7c1213617c"), "port": Number(43333), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("e8989f88-588d-46eb-a9e1-551a762b720c"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("0aedbaff-67ef-48a9-ad7b-2ed040b6bc12"), "time_created": String("2026-03-03T18:57:14.583557Z"), "time_modified": String("2026-03-03T18:57:14.583557Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}], Array [Object {"identity": Object {"id": String("e9d1f98f-6ec0-4943-9557-bf2fa89209f0"), "time_created": String("2026-03-03T18:57:06.781490Z"), "time_modified": String("2026-03-03T18:57:06.781490Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("89c5eff8-6d6c-4e5d-af23-e1e997d2ec42"), "port": Number(45597), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("e9d1f98f-6ec0-4943-9557-bf2fa89209f0"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("52432abd-5543-4e66-84b4-0860e0d5d0f5"), "time_created": String("2026-03-03T18:57:14.583557Z"), "time_modified": String("2026-03-03T18:57:14.583557Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}], Array [Object {"identity": Object {"id": String("f1c18a48-e3ab-4505-8dc5-08936c973d7a"), "time_created": String("2026-03-03T18:57:07.757545Z"), "time_modified": String("2026-03-03T18:57:07.757545Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("4663ee77-faf7-484d-b93c-0f9d30febdf8"), "port": Number(36599), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f1c18a48-e3ab-4505-8dc5-08936c973d7a"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("834fc6a7-dc21-4077-8af4-ba1a9cc2c506"), "time_created": String("2026-03-03T18:57:14.583557Z"), "time_modified": String("2026-03-03T18:57:14.583557Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}]]), 5: Succeeded(Null), 6: Succeeded(Object {"block_size": Number(512), "id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "read_only_parent": Null, "sub_volumes": Array [Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "extent_count": Number(16), "gen": Number(1), "opts": Object {"cert_pem": Null, "control": Null, "flush_timeout": Null, "id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "key": String("VWI5dFE9qLAhtWGDHLhvJGhLaOK3p9HRE4hj26wqPso="), "key_pem": Null, "lossy": Bool(false), "read_only": Bool(false), "root_cert_pem": Null, "target": Array [String("[::1]:1100"), String("[::1]:1050"), String("[::1]:1000")]}, "type": String("region")}], "type": String("volume")}), 7: Succeeded(Null), 8: Succeeded(Object {"Crucible": Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "name": String("d-1"), "time_created": String("2026-03-03T18:57:14.494366Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:14.494366Z")}, "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T18:57:14.494364421Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}}}), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Object {"Crucible": Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "name": String("d-1"), "time_created": String("2026-03-03T18:57:14.494366Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:14.494366Z")}, "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T18:57:14.494364421Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}}}, node_outputs: {"created_disk": Object {"Crucible": Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "name": String("d-1"), "time_created": String("2026-03-03T18:57:14.494366Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:14.494366Z")}, "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T18:57:14.494364421Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}}}, "created_volume": Null, "crucible_disk": Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "name": String("d-1"), "time_created": String("2026-03-03T18:57:14.494366Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:57:14.494366Z")}, "project_id": String("47174ca8-7062-4b5d-a8de-3ad573d1f493"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T18:57:14.494364421Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}}, "datasets_and_regions": Array [Array [Object {"identity": Object {"id": String("e8989f88-588d-46eb-a9e1-551a762b720c"), "time_created": String("2026-03-03T18:57:07.559137Z"), "time_modified": String("2026-03-03T18:57:07.559137Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("9ae7bc40-1cd5-400d-9ab1-bf7c1213617c"), "port": Number(43333), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("e8989f88-588d-46eb-a9e1-551a762b720c"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("0aedbaff-67ef-48a9-ad7b-2ed040b6bc12"), "time_created": String("2026-03-03T18:57:14.583557Z"), "time_modified": String("2026-03-03T18:57:14.583557Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}], Array [Object {"identity": Object {"id": String("e9d1f98f-6ec0-4943-9557-bf2fa89209f0"), "time_created": String("2026-03-03T18:57:06.781490Z"), "time_modified": String("2026-03-03T18:57:06.781490Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("89c5eff8-6d6c-4e5d-af23-e1e997d2ec42"), "port": Number(45597), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("e9d1f98f-6ec0-4943-9557-bf2fa89209f0"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("52432abd-5543-4e66-84b4-0860e0d5d0f5"), "time_created": String("2026-03-03T18:57:14.583557Z"), "time_modified": String("2026-03-03T18:57:14.583557Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}], Array [Object {"identity": Object {"id": String("f1c18a48-e3ab-4505-8dc5-08936c973d7a"), "time_created": String("2026-03-03T18:57:07.757545Z"), "time_modified": String("2026-03-03T18:57:07.757545Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("4663ee77-faf7-484d-b93c-0f9d30febdf8"), "port": Number(36599), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f1c18a48-e3ab-4505-8dc5-08936c973d7a"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("834fc6a7-dc21-4077-8af4-ba1a9cc2c506"), "time_created": String("2026-03-03T18:57:14.583557Z"), "time_modified": String("2026-03-03T18:57:14.583557Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")}]], "disk_id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "no_result": Null, "regions_ensure": Object {"block_size": Number(512), "id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "read_only_parent": Null, "sub_volumes": Array [Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "extent_count": Number(16), "gen": Number(1), "opts": Object {"cert_pem": Null, "control": Null, "flush_timeout": Null, "id": String("7db6946a-2497-4886-9b71-0d7b1a2bd12b"), "key": String("VWI5dFE9qLAhtWGDHLhvJGhLaOK3p9HRE4hj26wqPso="), "key_pem": Null, "lossy": Bool(false), "read_only": Bool(false), "root_cert_pem": Null, "target": Array [String("[::1]:1100"), String("[::1]:1050"), String("[::1]:1000")]}, "type": String("region")}], "type": String("volume")}, "regions_ensure_undo": Null, "volume_id": String("7758e618-62be-44b3-a902-8971502dfffd")} }) }
117732026-03-03T18:57:14.686ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
117742026-03-03T18:57:14.686ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
117752026-03-03T18:57:14.686ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
117762026-03-03T18:57:14.686ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
117772026-03-03T18:57:14.686ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
117782026-03-03T18:57:14.688ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
117792026-03-03T18:57:14.689ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
117802026-03-03T18:57:14.689ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
117812026-03-03T18:57:14.689ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
117822026-03-03T18:57:14.689ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
117832026-03-03T18:57:14.691ZINFOtest_metrics (dropshot_external): request completed latency_us = 249385 local_addr = 127.0.0.1:37769 method = POST remote_addr = 127.0.0.1:50678 req_id = d0c9e902-c24c-43ed-bf2e-8f2db36c762e response_code = 201 uri = /v1/disks?project=p-1
117842026-03-03T18:57:14.691ZINFOtest_metrics (external client test context): client received response status = 201
117852026-03-03T18:57:14.692ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
117862026-03-03T18:57:14.692ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
117872026-03-03T18:57:14.692ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493 version = 2026021900.0.0
117882026-03-03T18:57:14.692ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
117892026-03-03T18:57:14.692ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
117902026-03-03T18:57:14.692ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117912026-03-03T18:57:14.692ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
117922026-03-03T18:57:14.692ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117932026-03-03T18:57:14.693ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117942026-03-03T18:57:14.693ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
117952026-03-03T18:57:14.694ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117962026-03-03T18:57:14.695ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
117972026-03-03T18:57:14.695ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
117982026-03-03T18:57:14.695ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117992026-03-03T18:57:14.695ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118002026-03-03T18:57:14.695ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118012026-03-03T18:57:14.696ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
118022026-03-03T18:57:14.696ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118032026-03-03T18:57:14.696ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118042026-03-03T18:57:14.696ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118052026-03-03T18:57:14.697ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
118062026-03-03T18:57:14.699ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
118072026-03-03T18:57:14.699ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118082026-03-03T18:57:14.699ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118092026-03-03T18:57:14.700ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118102026-03-03T18:57:14.700ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
118112026-03-03T18:57:14.700ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
118122026-03-03T18:57:14.701ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118132026-03-03T18:57:14.701ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118142026-03-03T18:57:14.701ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118152026-03-03T18:57:14.702ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
118162026-03-03T18:57:14.702ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118172026-03-03T18:57:14.702ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118182026-03-03T18:57:14.702ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118192026-03-03T18:57:14.703ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
118202026-03-03T18:57:14.705ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
118212026-03-03T18:57:14.705ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118222026-03-03T18:57:14.705ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118232026-03-03T18:57:14.705ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118242026-03-03T18:57:14.705ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118252026-03-03T18:57:14.705ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118262026-03-03T18:57:14.705ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118272026-03-03T18:57:14.707ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118282026-03-03T18:57:14.707ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118292026-03-03T18:57:14.707ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118302026-03-03T18:57:14.707ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118312026-03-03T18:57:14.708ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118322026-03-03T18:57:14.710ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118332026-03-03T18:57:14.710ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118342026-03-03T18:57:14.710ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118352026-03-03T18:57:14.710ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118362026-03-03T18:57:14.711ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118372026-03-03T18:57:14.711ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118382026-03-03T18:57:14.712ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118392026-03-03T18:57:14.712ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118402026-03-03T18:57:14.712ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118412026-03-03T18:57:14.712ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118422026-03-03T18:57:14.713ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118432026-03-03T18:57:14.713ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118442026-03-03T18:57:14.714ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118452026-03-03T18:57:14.714ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118462026-03-03T18:57:14.714ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118472026-03-03T18:57:14.714ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118482026-03-03T18:57:14.716ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118492026-03-03T18:57:14.716ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118502026-03-03T18:57:14.716ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118512026-03-03T18:57:14.716ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118522026-03-03T18:57:14.717ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118532026-03-03T18:57:14.722ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118542026-03-03T18:57:14.722ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118552026-03-03T18:57:14.722ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118562026-03-03T18:57:14.722ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118572026-03-03T18:57:14.722ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118582026-03-03T18:57:14.722ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118592026-03-03T18:57:14.723ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118602026-03-03T18:57:14.723ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118612026-03-03T18:57:14.723ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118622026-03-03T18:57:14.724ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118632026-03-03T18:57:14.725ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118642026-03-03T18:57:14.726ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118652026-03-03T18:57:14.728ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '47174ca8-7062-4b5d-a8de-3ad573d1f493') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
118662026-03-03T18:57:14.730ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (11045350386984208624) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:14.692022418' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
118672026-03-03T18:57:14.732ZINFOtest_metrics (dropshot_external): request completed latency_us = 40641 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 86e0c868-a8de-444c-b3b9-f37edfbad3a8 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.692022418Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118682026-03-03T18:57:14.733ZINFOtest_metrics (external client test context): client received response status = 200
118692026-03-03T18:57:14.733ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118702026-03-03T18:57:14.733ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118712026-03-03T18:57:14.733ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493 version = 2026021900.0.0
118722026-03-03T18:57:14.733ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118732026-03-03T18:57:14.733ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
118742026-03-03T18:57:14.733ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118752026-03-03T18:57:14.733ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118762026-03-03T18:57:14.734ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118772026-03-03T18:57:14.735ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118782026-03-03T18:57:14.735ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118792026-03-03T18:57:14.735ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118802026-03-03T18:57:14.736ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
118812026-03-03T18:57:14.736ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
118822026-03-03T18:57:14.736ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118832026-03-03T18:57:14.736ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118842026-03-03T18:57:14.737ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118852026-03-03T18:57:14.738ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
118862026-03-03T18:57:14.738ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118872026-03-03T18:57:14.738ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118882026-03-03T18:57:14.738ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118892026-03-03T18:57:14.739ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
118902026-03-03T18:57:14.741ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
118912026-03-03T18:57:14.741ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118922026-03-03T18:57:14.741ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118932026-03-03T18:57:14.741ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118942026-03-03T18:57:14.742ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
118952026-03-03T18:57:14.742ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
118962026-03-03T18:57:14.742ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118972026-03-03T18:57:14.742ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118982026-03-03T18:57:14.743ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118992026-03-03T18:57:14.744ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
119002026-03-03T18:57:14.744ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119012026-03-03T18:57:14.744ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119022026-03-03T18:57:14.744ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119032026-03-03T18:57:14.745ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
119042026-03-03T18:57:14.747ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
119052026-03-03T18:57:14.747ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119062026-03-03T18:57:14.747ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119072026-03-03T18:57:14.747ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119082026-03-03T18:57:14.747ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119092026-03-03T18:57:14.747ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119102026-03-03T18:57:14.747ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119112026-03-03T18:57:14.748ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119122026-03-03T18:57:14.748ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119132026-03-03T18:57:14.748ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119142026-03-03T18:57:14.749ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119152026-03-03T18:57:14.750ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119162026-03-03T18:57:14.752ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119172026-03-03T18:57:14.752ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119182026-03-03T18:57:14.752ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119192026-03-03T18:57:14.752ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119202026-03-03T18:57:14.753ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119212026-03-03T18:57:14.753ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119222026-03-03T18:57:14.753ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119232026-03-03T18:57:14.754ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119242026-03-03T18:57:14.754ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119252026-03-03T18:57:14.754ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119262026-03-03T18:57:14.754ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119272026-03-03T18:57:14.754ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119282026-03-03T18:57:14.756ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119292026-03-03T18:57:14.756ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119302026-03-03T18:57:14.756ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119312026-03-03T18:57:14.756ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119322026-03-03T18:57:14.757ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119332026-03-03T18:57:14.757ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119342026-03-03T18:57:14.758ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119352026-03-03T18:57:14.758ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119362026-03-03T18:57:14.759ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119372026-03-03T18:57:14.763ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119382026-03-03T18:57:14.764ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119392026-03-03T18:57:14.764ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119402026-03-03T18:57:14.764ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119412026-03-03T18:57:14.764ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119422026-03-03T18:57:14.764ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119432026-03-03T18:57:14.765ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119442026-03-03T18:57:14.765ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119452026-03-03T18:57:14.765ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119462026-03-03T18:57:14.766ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119472026-03-03T18:57:14.766ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
119482026-03-03T18:57:14.766ZDEBGtest_metrics (results-sink-cluster): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
119492026-03-03T18:57:14.766ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
119502026-03-03T18:57:14.766ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
119512026-03-03T18:57:14.766ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
119522026-03-03T18:57:14.766ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
119532026-03-03T18:57:14.766ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
119542026-03-03T18:57:14.766ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = adebf529-eb08-4136-99e1-d9ea29121a14 uri = /913233fe-92a8-4635-9572-183f495429c4
119552026-03-03T18:57:14.772ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5446 local_addr = 127.0.0.1:41769 method = GET remote_addr = 127.0.0.1:53338 req_id = adebf529-eb08-4136-99e1-d9ea29121a14 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
119562026-03-03T18:57:14.772ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119572026-03-03T18:57:14.774ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119582026-03-03T18:57:14.775ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '47174ca8-7062-4b5d-a8de-3ad573d1f493') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
119592026-03-03T18:57:14.775ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
119602026-03-03T18:57:14.783ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
119612026-03-03T18:57:14.783ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
119622026-03-03T18:57:14.783ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 41769
119632026-03-03T18:57:14.783ZDEBGtest_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
119642026-03-03T18:57:14.783ZDEBGtest_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af
119652026-03-03T18:57:14.789ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
119662026-03-03T18:57:14.789ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (8721817720517468360) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:14.733386034' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
119672026-03-03T18:57:14.790ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 32 table_name = fields_string
119682026-03-03T18:57:14.790ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
119692026-03-03T18:57:14.791ZINFOtest_metrics (dropshot_external): request completed latency_us = 57968 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 49eabb74-851d-4867-994c-026ac0f70fca response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.733386034Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119702026-03-03T18:57:14.791ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 16 table_name = fields_u16
119712026-03-03T18:57:14.791ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
119722026-03-03T18:57:14.791ZINFOtest_metrics (external client test context): client received response status = 200
119732026-03-03T18:57:14.792ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119742026-03-03T18:57:14.792ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119752026-03-03T18:57:14.792ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493 version = 2026021900.0.0
119762026-03-03T18:57:14.792ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119772026-03-03T18:57:14.792ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
119782026-03-03T18:57:14.792ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119792026-03-03T18:57:14.792ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119802026-03-03T18:57:14.793ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119812026-03-03T18:57:14.793ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 16 table_name = fields_uuid
119822026-03-03T18:57:14.793ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
119832026-03-03T18:57:14.794ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119842026-03-03T18:57:14.794ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119852026-03-03T18:57:14.795ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119862026-03-03T18:57:14.795ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 2568bf13-0864-45a2-9ec3-c4a482c0a0af n_rows = 16 table_name = measurements_histogramu64
119872026-03-03T18:57:14.795ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
119882026-03-03T18:57:14.796ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
119892026-03-03T18:57:14.796ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
119902026-03-03T18:57:14.796ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119912026-03-03T18:57:14.796ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119922026-03-03T18:57:14.796ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119932026-03-03T18:57:14.797ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
119942026-03-03T18:57:14.798ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119952026-03-03T18:57:14.798ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119962026-03-03T18:57:14.798ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119972026-03-03T18:57:14.799ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
119982026-03-03T18:57:14.801ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
119992026-03-03T18:57:14.801ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120002026-03-03T18:57:14.801ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120012026-03-03T18:57:14.801ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120022026-03-03T18:57:14.802ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
120032026-03-03T18:57:14.802ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
120042026-03-03T18:57:14.802ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120052026-03-03T18:57:14.802ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120062026-03-03T18:57:14.802ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120072026-03-03T18:57:14.803ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
120082026-03-03T18:57:14.803ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120092026-03-03T18:57:14.803ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120102026-03-03T18:57:14.804ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120112026-03-03T18:57:14.804ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
120122026-03-03T18:57:14.806ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
120132026-03-03T18:57:14.806ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120142026-03-03T18:57:14.806ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120152026-03-03T18:57:14.806ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120162026-03-03T18:57:14.806ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120172026-03-03T18:57:14.806ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120182026-03-03T18:57:14.807ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120192026-03-03T18:57:14.808ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120202026-03-03T18:57:14.808ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120212026-03-03T18:57:14.808ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120222026-03-03T18:57:14.809ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120232026-03-03T18:57:14.810ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120242026-03-03T18:57:14.812ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120252026-03-03T18:57:14.812ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120262026-03-03T18:57:14.812ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120272026-03-03T18:57:14.812ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120282026-03-03T18:57:14.813ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120292026-03-03T18:57:14.813ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120302026-03-03T18:57:14.813ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120312026-03-03T18:57:14.814ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120322026-03-03T18:57:14.814ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource_id = 47174ca8-7062-4b5d-a8de-3ad573d1f493 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120332026-03-03T18:57:14.814ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120342026-03-03T18:57:14.814ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120352026-03-03T18:57:14.815ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120362026-03-03T18:57:14.816ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120372026-03-03T18:57:14.816ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120382026-03-03T18:57:14.816ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120392026-03-03T18:57:14.816ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120402026-03-03T18:57:14.817ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120412026-03-03T18:57:14.817ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120422026-03-03T18:57:14.817ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120432026-03-03T18:57:14.818ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120442026-03-03T18:57:14.819ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120452026-03-03T18:57:14.823ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 47174ca8-7062-4b5d-a8de-3ad573d1f493, lookup_type: ById(47174ca8-7062-4b5d-a8de-3ad573d1f493) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120462026-03-03T18:57:14.823ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120472026-03-03T18:57:14.823ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120482026-03-03T18:57:14.823ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120492026-03-03T18:57:14.823ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120502026-03-03T18:57:14.824ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120512026-03-03T18:57:14.825ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120522026-03-03T18:57:14.825ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120532026-03-03T18:57:14.825ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120542026-03-03T18:57:14.825ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120552026-03-03T18:57:14.827ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120562026-03-03T18:57:14.828ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120572026-03-03T18:57:14.830ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '47174ca8-7062-4b5d-a8de-3ad573d1f493') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
120582026-03-03T18:57:14.832ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (9383865214650852877) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:14.792074338' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
120592026-03-03T18:57:14.834ZINFOtest_metrics (dropshot_external): request completed latency_us = 42366 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 32a4bfbd-e6a4-4ab9-9079-eb7e6d22969a response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.792074338Z&order=descending&limit=1&project=47174ca8-7062-4b5d-a8de-3ad573d1f493
120602026-03-03T18:57:14.835ZINFOtest_metrics (external client test context): client received response status = 200
120612026-03-03T18:57:14.835ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:37769/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
120622026-03-03T18:57:14.835ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
120632026-03-03T18:57:14.835ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1 version = 2026021900.0.0
120642026-03-03T18:57:14.835ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
120652026-03-03T18:57:14.835ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
120662026-03-03T18:57:14.835ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120672026-03-03T18:57:14.835ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120682026-03-03T18:57:14.836ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120692026-03-03T18:57:14.837ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120702026-03-03T18:57:14.837ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120712026-03-03T18:57:14.837ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120722026-03-03T18:57:14.838ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
120732026-03-03T18:57:14.838ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
120742026-03-03T18:57:14.838ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120752026-03-03T18:57:14.838ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120762026-03-03T18:57:14.839ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120772026-03-03T18:57:14.839ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
120782026-03-03T18:57:14.840ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120792026-03-03T18:57:14.840ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120802026-03-03T18:57:14.840ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120812026-03-03T18:57:14.841ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
120822026-03-03T18:57:14.843ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
120832026-03-03T18:57:14.843ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120842026-03-03T18:57:14.843ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120852026-03-03T18:57:14.843ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120862026-03-03T18:57:14.844ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
120872026-03-03T18:57:14.844ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
120882026-03-03T18:57:14.844ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120892026-03-03T18:57:14.844ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120902026-03-03T18:57:14.844ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120912026-03-03T18:57:14.845ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
120922026-03-03T18:57:14.845ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120932026-03-03T18:57:14.845ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120942026-03-03T18:57:14.846ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120952026-03-03T18:57:14.846ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
120962026-03-03T18:57:14.848ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
120972026-03-03T18:57:14.848ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
120982026-03-03T18:57:14.848ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
120992026-03-03T18:57:14.848ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121002026-03-03T18:57:14.848ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121012026-03-03T18:57:14.848ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121022026-03-03T18:57:14.849ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121032026-03-03T18:57:14.850ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121042026-03-03T18:57:14.850ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121052026-03-03T18:57:14.850ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121062026-03-03T18:57:14.850ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121072026-03-03T18:57:14.852ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121082026-03-03T18:57:14.853ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121092026-03-03T18:57:14.853ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121102026-03-03T18:57:14.853ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121112026-03-03T18:57:14.853ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121122026-03-03T18:57:14.853ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121132026-03-03T18:57:14.854ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121142026-03-03T18:57:14.855ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121152026-03-03T18:57:14.855ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121162026-03-03T18:57:14.855ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121172026-03-03T18:57:14.855ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121182026-03-03T18:57:14.857ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121192026-03-03T18:57:14.858ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121202026-03-03T18:57:14.860ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
121212026-03-03T18:57:14.862ZTRACtest_metrics (clickhouse-client): executing SQL query id = 2c45dcb8-e3df-49d2-8eb3-7df39ffac70f sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 18:56:58.926246122' AND timestamp < '2026-03-03 18:57:14.835205667' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
121222026-03-03T18:57:14.864ZINFOtest_metrics (dropshot_external): request completed latency_us = 29143 local_addr = 127.0.0.1:37769 method = GET remote_addr = 127.0.0.1:50678 req_id = 3fd8d730-8ab1-4e3b-ac33-fad28520b3e5 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:56:58.926246122Z&end_time=2026-03-03T18:57:14.835205667Z&order=descending&limit=1
121232026-03-03T18:57:14.864ZINFOtest_metrics (external client test context): client received response status = 200